Sep 17 14:05:04.178919 ip-10-0-136-184 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 14:05:04.549568 ip-10-0-136-184 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:05:04.549568 ip-10-0-136-184 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 14:05:04.550156 ip-10-0-136-184 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:05:04.550156 ip-10-0-136-184 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 14:05:04.550156 ip-10-0-136-184 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:05:04.551434 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.551325    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559200    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559227    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559231    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559235    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559238    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559241    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559244    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559247    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559250    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.559234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559253    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559257    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559261    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559265    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559269    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559272    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559275    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559279    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559282    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559284    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559287    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559290    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559293    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559297    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559300    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559303    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559307    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559312    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559315    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.559652 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559318    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559321    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559324    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559327    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559337    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559340    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559343    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559345    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559348    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559351    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559353    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559356    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559359    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559362    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559364    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559368    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559371    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559373    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559376    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559379    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.560229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559381    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559384    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559387    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559389    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559392    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559395    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559398    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559400    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559403    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559406    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559409    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559411    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559414    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559417    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559419    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559422    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559425    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559427    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559430    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559433    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.560739 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559435    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559438    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559440    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559443    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559445    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559448    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559451    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559455    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559458    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559461    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559463    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559466    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559469    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559472    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559476    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559480    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559483    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559485    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559488    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559490    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.561229 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559493    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559496    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559498    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559501    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559504    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559507    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559509    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559512    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559515    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559517    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.559520    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560304    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560312    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560315    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560318    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560321    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560324    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560327    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560330    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560338    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.561774 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560340    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560343    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560346    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560348    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560351    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560354    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560357    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560360    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560363    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560366    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560368    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560371    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560374    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560377    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560379    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560382    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560385    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560387    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560390    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560393    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.562292 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560395    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560398    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560401    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560403    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560406    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560408    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560411    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560414    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560416    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560419    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560422    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560426    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560429    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560431    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560434    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560437    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560439    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560445    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560449    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.562813 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560452    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560456    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560459    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560461    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560464    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560467    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560470    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560472    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560475    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560477    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560480    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560483    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560485    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560489    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560493    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560496    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560499    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560506    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.563293 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560509    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560514    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560517    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560520    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560523    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560528    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560531    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560533    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560536    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560539    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560541    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560544    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560561    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560564    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560567    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560570    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560573    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560575    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560578    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560581    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.563779 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560583    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560586    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560588    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560591    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560594    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560596    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560599    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560602    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560605    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560608    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560610    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.560613    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561048    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561053    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561056    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561059    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561062    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561066    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561069    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561072    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561075    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.564308 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561078    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561080    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561083    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561086    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561089    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561091    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561094    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561097    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561100    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561103    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561105    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561108    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561110    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561113    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561115    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561118    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561121    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561123    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561128    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561131    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.564848 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561134    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561137    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561141    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561144    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561147    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561149    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561152    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561155    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561160    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561164    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561167    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561170    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561173    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561176    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561179    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561181    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561184    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561187    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561190    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561193    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.565370 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561196    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561199    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561201    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561204    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561206    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561209    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561212    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561215    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561219    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561221    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561225    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561228    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561231    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561234    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561237    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561242    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561245    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561248    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561251    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.565876 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561254    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561257    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561260    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561263    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561265    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561268    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561270    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561273    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561275    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561278    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561280    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561283    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561286    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561289    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561292    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561294    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561297    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561300    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561302    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561305    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.566386 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561308    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561310    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561313    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561315    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561318    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561320    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561323    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561325    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561329    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561332    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.561334    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561420    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561460    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561467    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561472    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561476    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561480    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561485    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561494    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561497    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561500    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 14:05:04.566953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561504    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561508    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561511    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561514    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561517    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561520    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561525    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561528    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561543    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561562    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561568    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561571    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561575    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561584    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561587    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561590    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561594    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561597    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561600    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561605    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561608    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561611    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561616    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561619    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561623    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 14:05:04.567646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561626    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561630    2560 flags.go:64] FLAG: --enable-server="true"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561633    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561638    2560 flags.go:64] FLAG: --event-burst="100"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561641    2560 flags.go:64] FLAG: --event-qps="50"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561644    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561647    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561650    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561654    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561657    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561661    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561664    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561667    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561670    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561674    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561677    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561680    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561683    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561686    2560 flags.go:64] FLAG: --feature-gates=""
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561691    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561694    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561697    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561700    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561704    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561707    2560 flags.go:64] FLAG: --help="false"
Sep 17 14:05:04.568268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561710    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561715    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561718    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561721    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561724    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561727    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561730    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561733    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561737    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561740    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561743    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561746    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561749    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561752    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561755    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561758    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561761    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561764    2560 flags.go:64] FLAG: --lock-file=""
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561768    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561771    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561774    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561780    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561783    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561786    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 14:05:04.568948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561790    2560 flags.go:64] FLAG: --logging-format="text"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561793    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561796    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561799    2560 flags.go:64] FLAG: --manifest-url=""
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561802    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561806    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561809    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561813    2560 flags.go:64] FLAG: --max-pods="110"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561817    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561823    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561826    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561829    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561832    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561835    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561840    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561848    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561851    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561855    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561858    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561861    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561866    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561869    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561873    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561876    2560 flags.go:64] FLAG: --port="10250"
Sep 17 14:05:04.569562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561879    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561882    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ea9d4d8ce39209a"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561886    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561889    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561892    2560 flags.go:64] FLAG: --register-node="true"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561896    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561899    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561903    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561906    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561909    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561913    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561916    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561919    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561922    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561925    2560 flags.go:64] FLAG: --runonce="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561928    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561932    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561935    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561939    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561943    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561946    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561949    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561953    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561956    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561960    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 14:05:04.570165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561963    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561966    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561969    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561972    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561975    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561981    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561984    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561987    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561992    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561995    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.561998    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562001    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562004    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562007    2560 flags.go:64] FLAG: --v="2"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562012    2560 flags.go:64] FLAG: --version="false"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562017    2560 flags.go:64] FLAG: --vmodule=""
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562021    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562024    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562150    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562154    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562157    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562161    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562165    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.570836 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562168    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562171    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562175    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562178    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562181    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562184    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562190    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562194    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562197    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562200    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562203    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562206    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562210    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562214    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562217    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562220    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562223    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562226    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562229    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.571401 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562232    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562234    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562237    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562240    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562243    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562245    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562249    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562251    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562254    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562257    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562260    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562263    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562265    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562268    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562273    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562278    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562280    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562283    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562286    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.571988 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562290    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562293    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562296    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562299    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562302    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562305    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562308    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562311    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562313    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562316    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562319    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562322    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562324    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562327    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562330    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562333    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562336    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562339    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562342    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562345    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.572455 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562348    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562351    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562353    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562356    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562359    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562362    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562364    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562367    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562373    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562376    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562379    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562382    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562386    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562388    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562391    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562394    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562397    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562399    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562402    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.572980 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562405    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562407    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562410    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562412    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562416    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562419    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562421    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562424    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562427    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562429    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562432    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562435    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562438    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562440    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562443    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562446    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.573451 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.562449    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.562455    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.570262    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.570283    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.571053    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.571065    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571135    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571141    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571145    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571147    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571151    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571154    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571157    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571160    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571163    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.573871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571166    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571169    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571171    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571174    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571177    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571179    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571182    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571186    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571189    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571191    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571194    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571198    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571203    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571206    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571208    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571211    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571214    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571216    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571219    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571221    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.574289 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571226    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571229    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571231    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571234    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571237    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571239    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571242    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571244    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571247    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571250    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571252    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571255    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571258    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571260    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571264    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571266    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571269    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571271    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571274    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571277    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.574808 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571280    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571283    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571286    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571290    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571294    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571297    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571301    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571304    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571308    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571310    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571314    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571317    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571321    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571328    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571331    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571335    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571338    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571341    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571344    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.575313 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571347    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571349    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571352    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571355    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571357    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571360    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571363    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571365    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571368    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571371    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571374    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571377    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571379    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571382    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571385    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571387    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571390    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571393    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571395    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571398    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.575809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571400    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571403    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571406    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571409    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571412    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571416    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571418    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571422    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571425    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571428    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571432    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.571437    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571575    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571581    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571585    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:05:04.576325 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571588    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571591    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571594    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571597    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571599    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571602    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571605    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571608    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571610    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571613    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571616    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571618    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571621    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571623    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571626    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571629    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571632    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571634    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571637    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571640    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:05:04.576726 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571642    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571645    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571648    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571651    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571654    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571658    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571660    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571663    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571666    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571669    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571673    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571676    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571679    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571682    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571684    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571687    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571691    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571694    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:05:04.577221 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571697    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571702    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571705    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571708    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571711    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571714    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571717    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571720    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571722    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571725    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571727    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571730    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571733    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571735    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571739    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571742    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571745    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571748    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571751    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:05:04.577700 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571753    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571758    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571761    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571764    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571766    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571769    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571772    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571775    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571778    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571780    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571783    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571786    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571789    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571791    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571794    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571797    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571800    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571802    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571805    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571808    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:05:04.578216 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571810    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571813    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571816    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571818    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571821    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571823    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571826    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571829    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571831    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571835    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571837    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571840    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571843    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571845    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571849    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571851    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571854    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571857    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:05:04.578738 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:04.571859    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.571865    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.572013    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.574220    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.575105    2560 server.go:1019] "Starting client certificate rotation"
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.575219    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.575272    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 14:05:04.579181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.577666    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 14:05:04.582910 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.582888    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 14:05:04.594586 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.594540    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 17 14:05:04.597702 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.597680    2560 log.go:25] "Validated CRI v1 image API"
Sep 17 14:05:04.598698 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.598670    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 14:05:04.601676 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.601649    2560 fs.go:135] Filesystem UUIDs: map[3554f650-71cd-4096-9aac-5f7d66f8ef85:/dev/nvme0n1p3 743b964f-643c-49ee-bea0-6360420e127a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 17 14:05:04.601676 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.601672    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 14:05:04.606906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.606766    2560 manager.go:216] Machine: {Timestamp:2026-09-17 14:05:04.605472455 +0000 UTC m=+0.314345261 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100804 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2412ab209119db47c354f87d6fff0b SystemUUID:ec2412ab-2091-19db-47c3-54f87d6fff0b BootID:f633ddce-326d-475f-9b92-ee47f4b92bd1 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fb:9a:db:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fb:9a:db:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:9b:f4:ad:68:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 14:05:04.606906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.606890    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 14:05:04.607102 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.606987    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 14:05:04.607312 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.607288    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 14:05:04.609976 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.609931    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 14:05:04.610178 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.609983    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 14:05:04.610823 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.610809    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 14:05:04.610879 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.610829    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 14:05:04.610879 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.610841    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 14:05:04.611508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.611494    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 14:05:04.613052 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.613036    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 14:05:04.616650 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616630    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 14:05:04.616828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616814    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 14:05:04.616887 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616859    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 14:05:04.616887 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616876    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 14:05:04.616968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616893    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 14:05:04.616968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616908    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 17 14:05:04.616968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.616921    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 14:05:04.617375 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.617358    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 14:05:04.617447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.617392    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 14:05:04.619534 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.619499    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 14:05:04.622536 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.622518    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 14:05:04.622620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.622576    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 14:05:04.624392 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624377    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 14:05:04.624437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624401    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 14:05:04.624437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624410    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 14:05:04.624437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624419    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 14:05:04.624437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624430    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 14:05:04.624437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624438    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624457    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624465    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624476    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624484    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624497    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 14:05:04.624576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.624504    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 14:05:04.625266 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.625226    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 14:05:04.625266 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.625238    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 14:05:04.627919 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.627896    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 14:05:04.628071 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.628050    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 14:05:04.628177 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.628163    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 14:05:04.629779 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.629766    2560 server.go:1268] "Started kubelet"
Sep 17 14:05:04.629889 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.629846    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 14:05:04.629964 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.629936    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 14:05:04.630019 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.629995    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 14:05:04.632004 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.631966    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 14:05:04.632745 ip-10-0-136-184 systemd[1]: Started Kubernetes Kubelet.
Sep 17 14:05:04.633928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.633847    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 14:05:04.636670 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.636643    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 14:05:04.639945 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.639024    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-184.ec2.internal.18d620be88588b29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-184.ec2.internal,UID:ip-10-0-136-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-184.ec2.internal,},FirstTimestamp:2026-09-17 14:05:04.629730089 +0000 UTC m=+0.338602938,LastTimestamp:2026-09-17 14:05:04.629730089 +0000 UTC m=+0.338602938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-184.ec2.internal,}"
Sep 17 14:05:04.641985 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.641965    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 14:05:04.642614 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.642597    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 14:05:04.642712 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.642691    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:04.643348 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643324    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 14:05:04.643348 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643343    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 14:05:04.643489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643324    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 14:05:04.643489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643428    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 14:05:04.643489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643434    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 14:05:04.643813 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643794    2560 factory.go:153] Registering CRI-O factory
Sep 17 14:05:04.643813 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643815    2560 factory.go:223] Registration of the crio container factory successfully
Sep 17 14:05:04.643936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643865    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 14:05:04.643936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643875    2560 factory.go:55] Registering systemd factory
Sep 17 14:05:04.643936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643882    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 17 14:05:04.643936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643900    2560 factory.go:103] Registering Raw factory
Sep 17 14:05:04.643936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.643915    2560 manager.go:1196] Started watching for new ooms in manager
Sep 17 14:05:04.644305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.644290    2560 manager.go:349] Starting recovery of all containers
Sep 17 14:05:04.652562 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.652499    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 14:05:04.652739 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.652711    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 14:05:04.652862 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.652840    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 14:05:04.654304 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.654287    2560 manager.go:354] Recovery completed
Sep 17 14:05:04.656690 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.656661    2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 17 14:05:04.660446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.660427    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.662891 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.662681    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.662983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.662908    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.662983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.662923    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.663602 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.663530    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 14:05:04.663602 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.663580    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.663717 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.663584    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 14:05:04.663717 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.663669    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 14:05:04.664637 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.664532    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-184.ec2.internal.18d620be8a5283e8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-184.ec2.internal,UID:ip-10-0-136-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-184.ec2.internal,},FirstTimestamp:2026-09-17 14:05:04.662889448 +0000 UTC m=+0.371762263,LastTimestamp:2026-09-17 14:05:04.662889448 +0000 UTC m=+0.371762263,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-184.ec2.internal,}"
Sep 17 14:05:04.664873 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664854    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.664952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664887    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.664952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664898    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.665034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664966    2560 policy_none.go:49] "None policy: Start"
Sep 17 14:05:04.665034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664981    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 14:05:04.665034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.664992    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 14:05:04.666026 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.666013    2560 policy_none.go:47] "Start"
Sep 17 14:05:04.671852 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.671828    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5rgt"
Sep 17 14:05:04.675471 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.675385    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-184.ec2.internal.18d620be8a52ea62  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-184.ec2.internal,UID:ip-10-0-136-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-184.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-184.ec2.internal,},FirstTimestamp:2026-09-17 14:05:04.662915682 +0000 UTC m=+0.371788490,LastTimestamp:2026-09-17 14:05:04.662915682 +0000 UTC m=+0.371788490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-184.ec2.internal,}"
Sep 17 14:05:04.681865 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.681842    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5rgt"
Sep 17 14:05:04.683243 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.683144    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-184.ec2.internal.18d620be8a531b8e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-184.ec2.internal,UID:ip-10-0-136-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-184.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-184.ec2.internal,},FirstTimestamp:2026-09-17 14:05:04.66292827 +0000 UTC m=+0.371801082,LastTimestamp:2026-09-17 14:05:04.66292827 +0000 UTC m=+0.371801082,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-184.ec2.internal,}"
Sep 17 14:05:04.727275 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727256    2560 manager.go:337] "Starting Device Plugin manager"
Sep 17 14:05:04.727410 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.727303    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 14:05:04.727410 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727314    2560 server.go:87] "Starting device plugin registration server"
Sep 17 14:05:04.727686 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727676    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 14:05:04.727735 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727687    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 14:05:04.727809 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727790    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 14:05:04.727899 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727884    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 14:05:04.727899 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.727898    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 14:05:04.728601 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.728577    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 14:05:04.728697 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.728642    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:04.781997 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.781964    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 14:05:04.782160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.782026    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 14:05:04.782160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.782053    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 14:05:04.782160 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.782154    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 14:05:04.784790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.784767    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:04.828075 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.827972    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.829055 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.829032    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.829150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.829072    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.829150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.829088    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.829150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.829115    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.835396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.835375    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.835462 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.835405    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-184.ec2.internal\": node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:04.853685 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.853646    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:04.882428 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.882381    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"]
Sep 17 14:05:04.882590 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.882481    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.883997 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.883977    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.884133 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.884009    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.884133 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.884023    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.885395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.885378    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.885525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.885507    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.885609 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.885557    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.886217 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886201    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.886217 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886208    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.886310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886229    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.886310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886240    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.886310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886230    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.886414 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.886326    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.887753 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.887738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.887798 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.887766    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:05:04.888488 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.888473    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:05:04.888559 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.888503    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:05:04.888559 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:04.888515    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:05:04.905326 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.905295    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-184.ec2.internal\" not found" node="ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.910285 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.910263    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-184.ec2.internal\" not found" node="ip-10-0-136-184.ec2.internal"
Sep 17 14:05:04.954317 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:04.954278    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.044370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.044329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d667033f2e5864bd6fbd882608a96f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-184.ec2.internal\" (UID: \"1d667033f2e5864bd6fbd882608a96f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.044370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.044365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.044614 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.044396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.055247 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.055215    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.145512 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.145512 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.145512 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d667033f2e5864bd6fbd882608a96f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-184.ec2.internal\" (UID: \"1d667033f2e5864bd6fbd882608a96f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.145749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.145749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f033d02028f046fe44e1bcdeca84c768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal\" (UID: \"f033d02028f046fe44e1bcdeca84c768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.145749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.145578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d667033f2e5864bd6fbd882608a96f9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-184.ec2.internal\" (UID: \"1d667033f2e5864bd6fbd882608a96f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.155540 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.155510    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.208732 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.208693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.214971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.214949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.256631 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.256601    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.357137 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.357107    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.457834 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.457742    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.516455 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.516425    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:05.558883 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.558841    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-184.ec2.internal\" not found"
Sep 17 14:05:05.561901 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.561877    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:05.574706 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.574674    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 14:05:05.574854 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.574832    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 14:05:05.574900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.574859    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 14:05:05.574900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.574862    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 14:05:05.602276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.602244    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:05.617511 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.617468    2560 apiserver.go:52] "Watching apiserver"
Sep 17 14:05:05.625712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.625681    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 14:05:05.626046 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.626023    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-829tm","openshift-network-diagnostics/network-check-target-hw2kz","openshift-network-operator/iptables-alerter-w8ddm","openshift-ovn-kubernetes/ovnkube-node-gk9qc","kube-system/global-pull-secret-syncer-brs66","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764","openshift-multus/multus-2bdvg","openshift-multus/multus-additional-cni-plugins-rg2zs","kube-system/konnectivity-agent-8tl99","openshift-cluster-node-tuning-operator/tuned-kcgnz","openshift-dns/node-resolver-b2bcx","openshift-image-registry/node-ca-v69kn"]
Sep 17 14:05:05.627469 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.627451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.627584 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.627565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:05.629033 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.629003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:05.629146 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.629126    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:05.631095 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.631061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.632971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.632951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.634120 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.634099    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.634219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.634100    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.634219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.634100    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 14:05:05.634219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.634105    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7xcmx\""
Sep 17 14:05:05.634407 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.634388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.634483 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.634460    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:05.635242 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.635227    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9qxwm\""
Sep 17 14:05:05.635310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.635256    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.635613 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.635596    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 14:05:05.635825 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.635809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.636498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.636482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.636593 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.636482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 14:05:05.636593 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.636518    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 14:05:05.636699 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.636636    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 14:05:05.637197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.637183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.638052 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.638034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 14:05:05.638109 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.638092    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.638153 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.638124    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.638361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.638347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-52pb5\""
Sep 17 14:05:05.638581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.638567    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.639415 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639399    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.639468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639398    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 14:05:05.639644 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639632    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 14:05:05.639927 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.640028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.640028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.639983    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5zps9\""
Sep 17 14:05:05.640903 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.640888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 14:05:05.641011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.640996    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wjt26\""
Sep 17 14:05:05.641064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.641023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 14:05:05.641379 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.641363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.642043 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642031    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 14:05:05.642173 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642160    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 14:05:05.642379 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 14:05:05.642592 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.642683 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4x77w\""
Sep 17 14:05:05.642874 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.642859    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.643492 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.643474    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.643647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.643628    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.643725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.643694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ndpsd\""
Sep 17 14:05:05.644411 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.644391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.644819 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.644797    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-587tq\""
Sep 17 14:05:05.644917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.644846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.644917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.644886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.646500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.646484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 14:05:05.646674 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.646659    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 14:05:05.646863 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.646849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 14:05:05.646959 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.646945    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bjrvl\""
Sep 17 14:05:05.648789 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.648771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-env-overrides\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.648894 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.648805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-kubelet\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.648894 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.648824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-cnibin\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.648894 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.648839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qklv\" (UniqueName: \"kubernetes.io/projected/4bde3f45-ccec-4cde-9123-ee6a980dda9b-kube-api-access-8qklv\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.649729 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f540d4-9be9-4dd8-84e6-fe034aeb9123-hosts-file\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.649729 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bde3f45-ccec-4cde-9123-ee6a980dda9b-host\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.649729 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.649729 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5852e837-7271-49c0-a9ce-06e7b6fbc840-konnectivity-ca\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.649974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-kubernetes\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.649974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6ps\" (UniqueName: \"kubernetes.io/projected/d0587018-d1f7-457c-a4d8-fd91907bb935-kube-api-access-hg6ps\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.649974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-sys-fs\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.649974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.649974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-multus\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.649994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-etc-tuned\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-netns\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-bin\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-kubelet-config\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-socket-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.650203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-system-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cni-binary-copy\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-socket-dir-parent\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-etc-kubernetes\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hjkk\" (UniqueName: \"kubernetes.io/projected/b0f115e0-32d8-47af-a630-ac0d8972c7ce-kube-api-access-8hjkk\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysconfig\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88tl\" (UniqueName: \"kubernetes.io/projected/226cb210-1d7c-41f6-8877-256382785171-kube-api-access-q88tl\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-netns\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-hostroot\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-conf\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650499 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggpz4\" (UniqueName: \"kubernetes.io/projected/b193fc08-becc-45a8-972f-309e6c726fde-kube-api-access-ggpz4\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-netd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80402c8b-9479-40e2-a83a-cf362cf66431-ovn-node-metrics-cert\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cnibin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-tmp\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bde3f45-ccec-4cde-9123-ee6a980dda9b-serviceca\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-registration-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-bin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-node-log\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-system-cni-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdd41784-9f32-4939-859b-6934a9f6fe9c-iptables-alerter-script\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd41784-9f32-4939-859b-6934a9f6fe9c-host-slash\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-run\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.650939 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-log-socket\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.650969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-dbus\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-systemd\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-sys\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-script-lib\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7jf\" (UniqueName: \"kubernetes.io/projected/b8d1479d-0939-409c-a686-b6e6cec125d7-kube-api-access-2k7jf\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-slash\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-ovn\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f540d4-9be9-4dd8-84e6-fe034aeb9123-tmp-dir\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-host\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-etc-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-config\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.651621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8d9\" (UniqueName: \"kubernetes.io/projected/bdd41784-9f32-4939-859b-6934a9f6fe9c-kube-api-access-5f8d9\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5852e837-7271-49c0-a9ce-06e7b6fbc840-agent-certs\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-systemd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-multus-certs\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-modprobe-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-lib-modules\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-var-lib-kubelet\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2sw\" (UniqueName: \"kubernetes.io/projected/80402c8b-9479-40e2-a83a-cf362cf66431-kube-api-access-tm2sw\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gdm\" (UniqueName: \"kubernetes.io/projected/18f540d4-9be9-4dd8-84e6-fe034aeb9123-kube-api-access-x7gdm\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-device-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-conf-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-daemon-config\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-systemd-units\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.652338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-k8s-cni-cncf-io\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.653021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:05.653021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.651977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-kubelet\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.653021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.652009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-var-lib-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.654785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.654764    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 14:05:05.654872 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.654844    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"
Sep 17 14:05:05.655080 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.655064    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal"]
Sep 17 14:05:05.657885 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.657859    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 14:05:05.663625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.663601    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal"]
Sep 17 14:05:05.664649 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.664633    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 14:05:05.684322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.684260    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 14:00:04 +0000 UTC" deadline="2028-03-26 21:07:25.739673297 +0000 UTC"
Sep 17 14:05:05.684322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.684319    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13351h2m20.05535911s"
Sep 17 14:05:05.707737 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.707707    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fptmv"
Sep 17 14:05:05.719840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.719813    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fptmv"
Sep 17 14:05:05.744846 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.744818    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 14:05:05.753034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-dbus\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-systemd\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-systemd\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-dbus\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-sys\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-script-lib\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7jf\" (UniqueName: \"kubernetes.io/projected/b8d1479d-0939-409c-a686-b6e6cec125d7-kube-api-access-2k7jf\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-sys\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-slash\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-ovn\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753337    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-slash\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-ovn\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f540d4-9be9-4dd8-84e6-fe034aeb9123-tmp-dir\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-host\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-etc-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.753523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-config\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8d9\" (UniqueName: \"kubernetes.io/projected/bdd41784-9f32-4939-859b-6934a9f6fe9c-kube-api-access-5f8d9\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5852e837-7271-49c0-a9ce-06e7b6fbc840-agent-certs\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-etc-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-systemd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-run-systemd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-multus-certs\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-modprobe-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-lib-modules\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-var-lib-kubelet\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2sw\" (UniqueName: \"kubernetes.io/projected/80402c8b-9479-40e2-a83a-cf362cf66431-kube-api-access-tm2sw\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gdm\" (UniqueName: \"kubernetes.io/projected/18f540d4-9be9-4dd8-84e6-fe034aeb9123-kube-api-access-x7gdm\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-device-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-conf-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-daemon-config\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-systemd-units\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.754327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f540d4-9be9-4dd8-84e6-fe034aeb9123-tmp-dir\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-script-lib\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.753987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-host\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-multus-certs\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-lib-modules\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-var-lib-kubelet\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-modprobe-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-k8s-cni-cncf-io\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-device-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-kubelet\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-var-lib-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-conf-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.755204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-systemd-units\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-kubelet\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-env-overrides\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-kubelet\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-cnibin\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754378    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qklv\" (UniqueName: \"kubernetes.io/projected/4bde3f45-ccec-4cde-9123-ee6a980dda9b-kube-api-access-8qklv\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f540d4-9be9-4dd8-84e6-fe034aeb9123-hosts-file\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bde3f45-ccec-4cde-9123-ee6a980dda9b-host\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5852e837-7271-49c0-a9ce-06e7b6fbc840-konnectivity-ca\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-kubernetes\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bde3f45-ccec-4cde-9123-ee6a980dda9b-host\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6ps\" (UniqueName: \"kubernetes.io/projected/d0587018-d1f7-457c-a4d8-fd91907bb935-kube-api-access-hg6ps\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-var-lib-openvswitch\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-env-overrides\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.756106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f540d4-9be9-4dd8-84e6-fe034aeb9123-hosts-file\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-sys-fs\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.754845    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-cnibin\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-sys-fs\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-daemon-config\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.754937    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:06.254895095 +0000 UTC m=+1.963767892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-kubelet\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-kubernetes\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.754997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-multus\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-k8s-cni-cncf-io\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-multus\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-etc-tuned\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-netns\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.757045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-bin\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5852e837-7271-49c0-a9ce-06e7b6fbc840-konnectivity-ca\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-d\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-run-netns\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-kubelet-config\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/169122e2-78b6-4046-8762-c339f73b10ec-kubelet-config\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-socket-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-bin\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-system-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cni-binary-copy\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-socket-dir-parent\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/80402c8b-9479-40e2-a83a-cf362cf66431-ovnkube-config\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-etc-kubernetes\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-etc-kubernetes\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hjkk\" (UniqueName: \"kubernetes.io/projected/b0f115e0-32d8-47af-a630-ac0d8972c7ce-kube-api-access-8hjkk\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-multus-socket-dir-parent\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysconfig\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-socket-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.757876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-system-cni-dir\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88tl\" (UniqueName: \"kubernetes.io/projected/226cb210-1d7c-41f6-8877-256382785171-kube-api-access-q88tl\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-netns\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-hostroot\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysconfig\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-conf\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-run-netns\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggpz4\" (UniqueName: \"kubernetes.io/projected/b193fc08-becc-45a8-972f-309e6c726fde-kube-api-access-ggpz4\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-netd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-hostroot\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80402c8b-9479-40e2-a83a-cf362cf66431-ovn-node-metrics-cert\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-etc-sysctl-conf\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-host-cni-netd\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cnibin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-tmp\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.758760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bde3f45-ccec-4cde-9123-ee6a980dda9b-serviceca\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-registration-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cni-binary-copy\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-bin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-node-log\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/226cb210-1d7c-41f6-8877-256382785171-registration-dir\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.755976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-system-cni-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdd41784-9f32-4939-859b-6934a9f6fe9c-iptables-alerter-script\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd41784-9f32-4939-859b-6934a9f6fe9c-host-slash\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-run\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-log-socket\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-log-socket\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-host-var-lib-cni-bin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f115e0-32d8-47af-a630-ac0d8972c7ce-cnibin\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.756259    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.756323    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:06.25630487 +0000 UTC m=+1.965177679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:05.759724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd41784-9f32-4939-859b-6934a9f6fe9c-host-slash\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b193fc08-becc-45a8-972f-309e6c726fde-run\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bde3f45-ccec-4cde-9123-ee6a980dda9b-serviceca\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/80402c8b-9479-40e2-a83a-cf362cf66431-node-log\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d1479d-0939-409c-a686-b6e6cec125d7-system-cni-dir\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d1479d-0939-409c-a686-b6e6cec125d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.756762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdd41784-9f32-4939-859b-6934a9f6fe9c-iptables-alerter-script\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.758519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/80402c8b-9479-40e2-a83a-cf362cf66431-ovn-node-metrics-cert\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.758630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5852e837-7271-49c0-a9ce-06e7b6fbc840-agent-certs\") pod \"konnectivity-agent-8tl99\" (UID: \"5852e837-7271-49c0-a9ce-06e7b6fbc840\") " pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.758795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-etc-tuned\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.760627 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.759794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b193fc08-becc-45a8-972f-309e6c726fde-tmp\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.761870 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.761840    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:05.761870 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.761870    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:05.762066 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.761884    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:05.762066 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:05.761955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:06.261934979 +0000 UTC m=+1.970807804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:05.762668 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.762595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8d9\" (UniqueName: \"kubernetes.io/projected/bdd41784-9f32-4939-859b-6934a9f6fe9c-kube-api-access-5f8d9\") pod \"iptables-alerter-w8ddm\" (UID: \"bdd41784-9f32-4939-859b-6934a9f6fe9c\") " pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.763215 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.763188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gdm\" (UniqueName: \"kubernetes.io/projected/18f540d4-9be9-4dd8-84e6-fe034aeb9123-kube-api-access-x7gdm\") pod \"node-resolver-b2bcx\" (UID: \"18f540d4-9be9-4dd8-84e6-fe034aeb9123\") " pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:05.763932 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.763845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7jf\" (UniqueName: \"kubernetes.io/projected/b8d1479d-0939-409c-a686-b6e6cec125d7-kube-api-access-2k7jf\") pod \"multus-additional-cni-plugins-rg2zs\" (UID: \"b8d1479d-0939-409c-a686-b6e6cec125d7\") " pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:05.764275 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.764253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2sw\" (UniqueName: \"kubernetes.io/projected/80402c8b-9479-40e2-a83a-cf362cf66431-kube-api-access-tm2sw\") pod \"ovnkube-node-gk9qc\" (UID: \"80402c8b-9479-40e2-a83a-cf362cf66431\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.765073 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.765054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggpz4\" (UniqueName: \"kubernetes.io/projected/b193fc08-becc-45a8-972f-309e6c726fde-kube-api-access-ggpz4\") pod \"tuned-kcgnz\" (UID: \"b193fc08-becc-45a8-972f-309e6c726fde\") " pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:05.766190 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.765914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qklv\" (UniqueName: \"kubernetes.io/projected/4bde3f45-ccec-4cde-9123-ee6a980dda9b-kube-api-access-8qklv\") pod \"node-ca-v69kn\" (UID: \"4bde3f45-ccec-4cde-9123-ee6a980dda9b\") " pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.766288 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.766187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hjkk\" (UniqueName: \"kubernetes.io/projected/b0f115e0-32d8-47af-a630-ac0d8972c7ce-kube-api-access-8hjkk\") pod \"multus-2bdvg\" (UID: \"b0f115e0-32d8-47af-a630-ac0d8972c7ce\") " pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:05.766770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.766746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6ps\" (UniqueName: \"kubernetes.io/projected/d0587018-d1f7-457c-a4d8-fd91907bb935-kube-api-access-hg6ps\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:05.766872 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.766836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88tl\" (UniqueName: \"kubernetes.io/projected/226cb210-1d7c-41f6-8877-256382785171-kube-api-access-q88tl\") pod \"aws-ebs-csi-driver-node-r4764\" (UID: \"226cb210-1d7c-41f6-8877-256382785171\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.782177 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.782154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v69kn"
Sep 17 14:05:05.899440 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:05.899387    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d667033f2e5864bd6fbd882608a96f9.slice/crio-88505a16d8f835f7555f9d1ba0e9b6dcdccc4b12c19f90154c23249d79589406 WatchSource:0}: Error finding container 88505a16d8f835f7555f9d1ba0e9b6dcdccc4b12c19f90154c23249d79589406: Status 404 returned error can't find the container with id 88505a16d8f835f7555f9d1ba0e9b6dcdccc4b12c19f90154c23249d79589406
Sep 17 14:05:05.899815 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:05.899794    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf033d02028f046fe44e1bcdeca84c768.slice/crio-b9118a1de15e26f6c947abce90e098430bc1991afdb2aaf72292643e4920bcda WatchSource:0}: Error finding container b9118a1de15e26f6c947abce90e098430bc1991afdb2aaf72292643e4920bcda: Status 404 returned error can't find the container with id b9118a1de15e26f6c947abce90e098430bc1991afdb2aaf72292643e4920bcda
Sep 17 14:05:05.904124 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.904107    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:05:05.955909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.955870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w8ddm"
Sep 17 14:05:05.965638 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:05.965609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd41784_9f32_4939_859b_6934a9f6fe9c.slice/crio-54e918942f7eef66f99a45256ce1a7bc723a36b3d0e1c4bc07bcc7f28e6a1b91 WatchSource:0}: Error finding container 54e918942f7eef66f99a45256ce1a7bc723a36b3d0e1c4bc07bcc7f28e6a1b91: Status 404 returned error can't find the container with id 54e918942f7eef66f99a45256ce1a7bc723a36b3d0e1c4bc07bcc7f28e6a1b91
Sep 17 14:05:05.972245 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.972223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:05.980685 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:05.980659    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80402c8b_9479_40e2_a83a_cf362cf66431.slice/crio-111e7634e1ae5cbb16007dbbff9fb202de7d760ea0dd1fee1fbc631145b1fc0c WatchSource:0}: Error finding container 111e7634e1ae5cbb16007dbbff9fb202de7d760ea0dd1fee1fbc631145b1fc0c: Status 404 returned error can't find the container with id 111e7634e1ae5cbb16007dbbff9fb202de7d760ea0dd1fee1fbc631145b1fc0c
Sep 17 14:05:05.987536 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:05.987516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764"
Sep 17 14:05:05.995986 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:05.995961    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226cb210_1d7c_41f6_8877_256382785171.slice/crio-fbb9293a36cacd06e2889645972199d9db10992f8a49d30f677466a57c814fb5 WatchSource:0}: Error finding container fbb9293a36cacd06e2889645972199d9db10992f8a49d30f677466a57c814fb5: Status 404 returned error can't find the container with id fbb9293a36cacd06e2889645972199d9db10992f8a49d30f677466a57c814fb5
Sep 17 14:05:06.004856 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.004831    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bdvg"
Sep 17 14:05:06.013297 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.013220    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f115e0_32d8_47af_a630_ac0d8972c7ce.slice/crio-188f95a8fe6996ad659f829911340419e5f14ef188e09144dc95b297abd1357d WatchSource:0}: Error finding container 188f95a8fe6996ad659f829911340419e5f14ef188e09144dc95b297abd1357d: Status 404 returned error can't find the container with id 188f95a8fe6996ad659f829911340419e5f14ef188e09144dc95b297abd1357d
Sep 17 14:05:06.014728 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.014631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rg2zs"
Sep 17 14:05:06.024331 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.024306    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d1479d_0939_409c_a686_b6e6cec125d7.slice/crio-dfd5fc60cdf3e7bf1a02c7bfbbf0778a9d1cda434ddcc808d3197b74632b407f WatchSource:0}: Error finding container dfd5fc60cdf3e7bf1a02c7bfbbf0778a9d1cda434ddcc808d3197b74632b407f: Status 404 returned error can't find the container with id dfd5fc60cdf3e7bf1a02c7bfbbf0778a9d1cda434ddcc808d3197b74632b407f
Sep 17 14:05:06.029655 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.029635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:06.038157 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.038127    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5852e837_7271_49c0_a9ce_06e7b6fbc840.slice/crio-245f9876057ebe22cac810566c21e5a3fe8c37230b719268a30e5c641531de4c WatchSource:0}: Error finding container 245f9876057ebe22cac810566c21e5a3fe8c37230b719268a30e5c641531de4c: Status 404 returned error can't find the container with id 245f9876057ebe22cac810566c21e5a3fe8c37230b719268a30e5c641531de4c
Sep 17 14:05:06.047404 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.047381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcgnz"
Sep 17 14:05:06.056035 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.056006    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb193fc08_becc_45a8_972f_309e6c726fde.slice/crio-88318ccb7cac7568e705494bde66d71247fb7c0b4f99d9b4752826d2dc13bcb4 WatchSource:0}: Error finding container 88318ccb7cac7568e705494bde66d71247fb7c0b4f99d9b4752826d2dc13bcb4: Status 404 returned error can't find the container with id 88318ccb7cac7568e705494bde66d71247fb7c0b4f99d9b4752826d2dc13bcb4
Sep 17 14:05:06.060270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.060245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2bcx"
Sep 17 14:05:06.068896 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.068867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f540d4_9be9_4dd8_84e6_fe034aeb9123.slice/crio-67d4cc6587e957cfcccd0ad8f6a5680056f2e29239b92eec3b8c5d974f0ffbeb WatchSource:0}: Error finding container 67d4cc6587e957cfcccd0ad8f6a5680056f2e29239b92eec3b8c5d974f0ffbeb: Status 404 returned error can't find the container with id 67d4cc6587e957cfcccd0ad8f6a5680056f2e29239b92eec3b8c5d974f0ffbeb
Sep 17 14:05:06.120994 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:06.120964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bde3f45_ccec_4cde_9123_ee6a980dda9b.slice/crio-aa923cd23eb9a59930f0aad3e03f24e5c8193d4a749dcc2106c3063525631fe8 WatchSource:0}: Error finding container aa923cd23eb9a59930f0aad3e03f24e5c8193d4a749dcc2106c3063525631fe8: Status 404 returned error can't find the container with id aa923cd23eb9a59930f0aad3e03f24e5c8193d4a749dcc2106c3063525631fe8
Sep 17 14:05:06.260227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.260141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:06.260227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.260207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:06.260461 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.260276    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:06.260461 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.260349    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:07.26032722 +0000 UTC m=+2.969200035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:06.260461 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.260349    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:06.260461 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.260416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:07.260397532 +0000 UTC m=+2.969270330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:06.360785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.360748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:06.360997 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.360963    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:06.360997 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.360990    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:06.361107 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.361003    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:06.361107 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.361065    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:07.361045334 +0000 UTC m=+3.069918131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:06.722561 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.722389    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:00:05 +0000 UTC" deadline="2028-05-03 21:16:17.275567851 +0000 UTC"
Sep 17 14:05:06.722561 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.722432    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14263h11m10.553140497s"
Sep 17 14:05:06.783115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.782464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:06.783115 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:06.782625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:06.797276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.797210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2bcx" event={"ID":"18f540d4-9be9-4dd8-84e6-fe034aeb9123","Type":"ContainerStarted","Data":"67d4cc6587e957cfcccd0ad8f6a5680056f2e29239b92eec3b8c5d974f0ffbeb"}
Sep 17 14:05:06.810251 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.810191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcgnz" event={"ID":"b193fc08-becc-45a8-972f-309e6c726fde","Type":"ContainerStarted","Data":"88318ccb7cac7568e705494bde66d71247fb7c0b4f99d9b4752826d2dc13bcb4"}
Sep 17 14:05:06.820050 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.819928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bdvg" event={"ID":"b0f115e0-32d8-47af-a630-ac0d8972c7ce","Type":"ContainerStarted","Data":"188f95a8fe6996ad659f829911340419e5f14ef188e09144dc95b297abd1357d"}
Sep 17 14:05:06.824960 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.824920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764" event={"ID":"226cb210-1d7c-41f6-8877-256382785171","Type":"ContainerStarted","Data":"fbb9293a36cacd06e2889645972199d9db10992f8a49d30f677466a57c814fb5"}
Sep 17 14:05:06.827673 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.827634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"111e7634e1ae5cbb16007dbbff9fb202de7d760ea0dd1fee1fbc631145b1fc0c"}
Sep 17 14:05:06.840383 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.840336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8ddm" event={"ID":"bdd41784-9f32-4939-859b-6934a9f6fe9c","Type":"ContainerStarted","Data":"54e918942f7eef66f99a45256ce1a7bc723a36b3d0e1c4bc07bcc7f28e6a1b91"}
Sep 17 14:05:06.846358 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.846321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal" event={"ID":"f033d02028f046fe44e1bcdeca84c768","Type":"ContainerStarted","Data":"b9118a1de15e26f6c947abce90e098430bc1991afdb2aaf72292643e4920bcda"}
Sep 17 14:05:06.854105 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.854025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v69kn" event={"ID":"4bde3f45-ccec-4cde-9123-ee6a980dda9b","Type":"ContainerStarted","Data":"aa923cd23eb9a59930f0aad3e03f24e5c8193d4a749dcc2106c3063525631fe8"}
Sep 17 14:05:06.857361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.857321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8tl99" event={"ID":"5852e837-7271-49c0-a9ce-06e7b6fbc840","Type":"ContainerStarted","Data":"245f9876057ebe22cac810566c21e5a3fe8c37230b719268a30e5c641531de4c"}
Sep 17 14:05:06.862401 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.862360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerStarted","Data":"dfd5fc60cdf3e7bf1a02c7bfbbf0778a9d1cda434ddcc808d3197b74632b407f"}
Sep 17 14:05:06.875488 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.875406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal" event={"ID":"1d667033f2e5864bd6fbd882608a96f9","Type":"ContainerStarted","Data":"88505a16d8f835f7555f9d1ba0e9b6dcdccc4b12c19f90154c23249d79589406"}
Sep 17 14:05:06.876337 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:06.876315    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:07.269648 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.269610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:07.269831 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.269697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:07.269831 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.269765    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:07.269831 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.269808    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:07.269989 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.269839    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:09.269819486 +0000 UTC m=+4.978692281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:07.269989 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.269860    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:09.269850951 +0000 UTC m=+4.978723748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:07.338471 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.338207    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:07.370932 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.370264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:07.370932 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.370457    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:07.370932 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.370481    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:07.370932 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.370495    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:07.370932 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.370574    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:09.370556228 +0000 UTC m=+5.079429037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:07.542194 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.542112    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:05:07.723374 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.723275    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:00:05 +0000 UTC" deadline="2028-02-13 22:17:57.46413765 +0000 UTC"
Sep 17 14:05:07.723374 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.723337    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12344h12m49.740804378s"
Sep 17 14:05:07.783000 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.782965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:07.783187 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.783091    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:07.783503 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:07.783474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:07.783624 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:07.783605    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:08.782521 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:08.782280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:08.783027 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:08.782651    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:09.288399 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:09.288358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:09.288631 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:09.288426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:09.288631 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.288564    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:09.288631 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.288628    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:13.288609146 +0000 UTC m=+8.997481945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:09.288980 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.288962    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:09.289096 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.289014    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:13.288999498 +0000 UTC m=+8.997872298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:09.389531 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:09.389488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:09.389724 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.389691    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:09.389724 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.389713    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:09.389809 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.389729    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:09.389809 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.389789    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:13.389770728 +0000 UTC m=+9.098643525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:09.783282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:09.783190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:09.783880 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.783336    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:09.783880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:09.783726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:09.783880 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:09.783839    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:10.789903 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:10.789872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:10.790382 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:10.790001    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:11.783336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:11.782658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:11.783336 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:11.782793    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:11.783336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:11.783178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:11.783336 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:11.783288    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:12.787543 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:12.787506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:12.788063 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:12.787657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:13.324200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:13.324115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:13.324200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:13.324188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:13.324450 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.324348    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:13.324450 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.324411    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:21.324392878 +0000 UTC m=+17.033265677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:13.324733 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.324708    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:13.324811 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.324782    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:21.324762876 +0000 UTC m=+17.033635675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:13.425205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:13.425129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:13.425398 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.425324    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:13.425398 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.425353    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:13.425398 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.425370    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:13.425589 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.425454    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:21.425433444 +0000 UTC m=+17.134306261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:13.782508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:13.782421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:13.782508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:13.782469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:13.782770 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.782575    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:13.782770 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:13.782674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:14.784146 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:14.784109    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:14.784600 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:14.784256    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:15.783089 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:15.782993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:15.783089 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:15.783052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:15.783323 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:15.783123    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:15.783323 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:15.783252    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:16.783195 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:16.783157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:16.783568 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:16.783268    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:17.783179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:17.783137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:17.783327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:17.783137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:17.783327 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:17.783250    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:17.783665 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:17.783344    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:18.783175 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:18.783137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:18.783379 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:18.783278    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:19.782370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:19.782333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:19.782542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:19.782382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:19.782542 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:19.782460    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:19.782670 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:19.782593    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:20.782645 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:20.782606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:20.783120 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:20.782753    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:21.388126 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:21.388021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:21.388126 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:21.388103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:21.388374 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.388165    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:21.388374 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.388238    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:21.388374 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.388267    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:37.388244185 +0000 UTC m=+33.097116983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:21.388374 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.388294    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:05:37.38827581 +0000 UTC m=+33.097148624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:21.489259 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:21.489210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:21.489444 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.489400    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:21.489444 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.489428    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:21.489444 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.489440    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:21.489567 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.489494    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:05:37.489480972 +0000 UTC m=+33.198353766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:21.783031 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:21.782939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:21.783031 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:21.783003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:21.783717 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.783111    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:21.783717 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:21.783229    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:22.783024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:22.782987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:22.783288 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:22.783132    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:23.782532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:23.782487    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:23.782743 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:23.782494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:23.782743 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:23.782617    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:23.782743 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:23.782716    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:24.782933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:24.782898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:24.783330 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:24.782994    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:25.782785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.782454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:25.782864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.782505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:25.782897 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:25.782864    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:25.782961 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:25.782945    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:25.929338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.929299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8tl99" event={"ID":"5852e837-7271-49c0-a9ce-06e7b6fbc840","Type":"ContainerStarted","Data":"271416971b10486aafef252d290d8a2ef9a6b7ca6dee32c81f9b2225c578cbba"}
Sep 17 14:05:25.931005 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.930977    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="e7d30d1b5380dd521df6e0f383d5416f864533912c6e5fae3a3eb467affdf041" exitCode=0
Sep 17 14:05:25.931171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.931020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"e7d30d1b5380dd521df6e0f383d5416f864533912c6e5fae3a3eb467affdf041"}
Sep 17 14:05:25.935735 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.935157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal" event={"ID":"1d667033f2e5864bd6fbd882608a96f9","Type":"ContainerStarted","Data":"7571cfaa1a44015b6a01a8ff6d8b3703c2149294cb775561d6e4a1bdc65d9a64"}
Sep 17 14:05:25.938074 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.938039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2bcx" event={"ID":"18f540d4-9be9-4dd8-84e6-fe034aeb9123","Type":"ContainerStarted","Data":"9fadb771021138ce8563acb3a6c8346b9d775ae703d0d17fe7daa060ef9fa7f5"}
Sep 17 14:05:25.940328 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.940294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcgnz" event={"ID":"b193fc08-becc-45a8-972f-309e6c726fde","Type":"ContainerStarted","Data":"214102d30f076cbcbef968d143be4c8c664511ad8ad352c8012329d4c3fd85a5"}
Sep 17 14:05:25.941985 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.941949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bdvg" event={"ID":"b0f115e0-32d8-47af-a630-ac0d8972c7ce","Type":"ContainerStarted","Data":"072212ab0f2b4ce484c0978f7ccdbcf7309ec20ffcaebcdda8bfab03ef91845a"}
Sep 17 14:05:25.943684 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.943656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764" event={"ID":"226cb210-1d7c-41f6-8877-256382785171","Type":"ContainerStarted","Data":"9e5c080d15781ec6c299097034578015ebcb4be40819a4bc611d59560484e3df"}
Sep 17 14:05:25.946991 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.946939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"53f775543d43c429be76e3bbf80d0c94e06de6b4ab8a94b7954fce126a8a90f2"}
Sep 17 14:05:25.947208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.947033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"50b15d16fdf9af6963938ff37583bca2912020029551b7631fc927d171c3698e"}
Sep 17 14:05:25.947208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.947071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"a46a9e0a29ee846cabd939e4eb70cba106a1810de7bfad21fa9e30b58f423687"}
Sep 17 14:05:25.947208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.947099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"3b7cd3584169a4f4e94450dfa5506b76b2992d67880b4bc69dcbeab033ed167c"}
Sep 17 14:05:25.947208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.947135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"4ca9c033c7b4aaf3ccf1a758f71186babe4a26f34d9c56751c62f565b3386165"}
Sep 17 14:05:25.947208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.947179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"298f726610d0f35f7c5d8bc1c090d38fe09873a5d1882c84c31371224985ddb7"}
Sep 17 14:05:25.948749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.948714    2560 generic.go:356] "Generic (PLEG): container finished" podID="f033d02028f046fe44e1bcdeca84c768" containerID="3dffd55d457a15053733110a5651060992e35447279c185f5c5f62fc982f2c25" exitCode=0
Sep 17 14:05:25.948866 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.948754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal" event={"ID":"f033d02028f046fe44e1bcdeca84c768","Type":"ContainerDied","Data":"3dffd55d457a15053733110a5651060992e35447279c185f5c5f62fc982f2c25"}
Sep 17 14:05:25.950616 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.950590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v69kn" event={"ID":"4bde3f45-ccec-4cde-9123-ee6a980dda9b","Type":"ContainerStarted","Data":"0ca31b47d0a5253594bf0d12ee74622a951691bf32048b2889ffc1c6051c3d10"}
Sep 17 14:05:25.965528 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.965461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8tl99" podStartSLOduration=2.998531261 podStartE2EDuration="21.965441347s" totalImagesPullingTime="18.966910086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:25.949770399 +0000 UTC m=+21.658643214" watchObservedRunningTime="2026-09-17 14:05:25.965441347 +0000 UTC m=+21.674314221"
Sep 17 14:05:25.965714 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.965636    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2bcx" podStartSLOduration=3.003220552 podStartE2EDuration="21.965629375s" totalImagesPullingTime="18.962408823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:25.965182737 +0000 UTC m=+21.674055554" watchObservedRunningTime="2026-09-17 14:05:25.965629375 +0000 UTC m=+21.674502191"
Sep 17 14:05:25.992017 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:25.991962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bdvg" podStartSLOduration=2.941627612 podStartE2EDuration="21.991946066s" totalImagesPullingTime="19.050318454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:25.991622925 +0000 UTC m=+21.700495742" watchObservedRunningTime="2026-09-17 14:05:25.991946066 +0000 UTC m=+21.700818878"
Sep 17 14:05:26.042022 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.041967    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kcgnz" podStartSLOduration=3.066652479 podStartE2EDuration="22.041948854s" totalImagesPullingTime="18.975296375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:26.041366615 +0000 UTC m=+21.750239433" watchObservedRunningTime="2026-09-17 14:05:26.041948854 +0000 UTC m=+21.750821714"
Sep 17 14:05:26.149159 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.149105    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-184.ec2.internal" podStartSLOduration=21.149087216 podStartE2EDuration="21.149087216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:26.131693701 +0000 UTC m=+21.840566517" watchObservedRunningTime="2026-09-17 14:05:26.149087216 +0000 UTC m=+21.857960029"
Sep 17 14:05:26.149407 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.149376    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v69kn" podStartSLOduration=7.173641528 podStartE2EDuration="22.149364096s" totalImagesPullingTime="14.975722568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:26.149230654 +0000 UTC m=+21.858103452" watchObservedRunningTime="2026-09-17 14:05:26.149364096 +0000 UTC m=+21.858236912"
Sep 17 14:05:26.787060 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.787031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:26.787709 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:26.787127    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:26.955064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.954771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w8ddm" event={"ID":"bdd41784-9f32-4939-859b-6934a9f6fe9c","Type":"ContainerStarted","Data":"5cdaceb0b7a39b50d514ba1358634245c6f890e083f00a698ad444edfc71561c"}
Sep 17 14:05:26.957020 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.956989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal" event={"ID":"f033d02028f046fe44e1bcdeca84c768","Type":"ContainerStarted","Data":"4106b5101188bdaca07db461447322de64141f9eedf0901ea99032c539b946dd"}
Sep 17 14:05:26.971301 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:26.971253    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w8ddm" podStartSLOduration=3.9320095200000003 podStartE2EDuration="22.971233739s" totalImagesPullingTime="19.039224219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:26.971229446 +0000 UTC m=+22.680102262" watchObservedRunningTime="2026-09-17 14:05:26.971233739 +0000 UTC m=+22.680106554"
Sep 17 14:05:27.097868 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.097834    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 14:05:27.738652 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.738502    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T14:05:27.097861127Z","UUID":"47dd72a6-ebde-4086-8387-d938dcc7f0a4","Handler":null,"Name":"","Endpoint":""}
Sep 17 14:05:27.740694 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.740669    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 14:05:27.740856 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.740705    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 14:05:27.782983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.782949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:27.783181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.782955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:27.783181 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:27.783088    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:27.783181 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:27.783162    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:27.961813 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:27.961776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764" event={"ID":"226cb210-1d7c-41f6-8877-256382785171","Type":"ContainerStarted","Data":"4a387e3ad7e4a2263e1e2811534eb905c2c22bff1129c024c8898c02e5c3972d"}
Sep 17 14:05:28.339815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.339498    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:28.340246 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.340222    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:28.356891 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.356711    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-184.ec2.internal" podStartSLOduration=23.356690304 podStartE2EDuration="23.356690304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:26.990064956 +0000 UTC m=+22.698937774" watchObservedRunningTime="2026-09-17 14:05:28.356690304 +0000 UTC m=+24.065563121"
Sep 17 14:05:28.783340 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.783218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:28.783517 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:28.783366    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:28.966953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.966905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764" event={"ID":"226cb210-1d7c-41f6-8877-256382785171","Type":"ContainerStarted","Data":"7c90b4ccdf6a83e29583ad1681e3b06dccdd33074753f5923740a910cdf32118"}
Sep 17 14:05:28.971352 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.971318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"62db3690448b78d121904335edfacf8c0aef9ecd8d43bca038c08f7b9640d1f1"}
Sep 17 14:05:28.971530 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.971408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:28.972028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.971984    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8tl99"
Sep 17 14:05:28.991111 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:28.991045    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4764" podStartSLOduration=3.4445592 podStartE2EDuration="24.991022188s" totalImagesPullingTime="21.546462988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:28.99095844 +0000 UTC m=+24.699831255" watchObservedRunningTime="2026-09-17 14:05:28.991022188 +0000 UTC m=+24.699894987"
Sep 17 14:05:29.783274 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:29.783235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:29.783514 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:29.783289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:29.783514 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:29.783389    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:29.783644 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:29.783521    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:30.785714 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:30.785683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:30.786196 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:30.785820    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:30.978140 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:30.978109    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="72a1efda1854c9103afdd5521bfd1fa21f151dad43716ed6ebe6ead959b94c71" exitCode=0
Sep 17 14:05:30.978299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:30.978197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"72a1efda1854c9103afdd5521bfd1fa21f151dad43716ed6ebe6ead959b94c71"}
Sep 17 14:05:30.982262 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:30.982224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" event={"ID":"80402c8b-9479-40e2-a83a-cf362cf66431","Type":"ContainerStarted","Data":"331c362c032faaab47b71ee4fd4aa85481bb5e6664f3feada36b3e69a3e17dbd"}
Sep 17 14:05:31.037229 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.037174    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc" podStartSLOduration=7.735460441 podStartE2EDuration="27.037157309s" totalImagesPullingTime="19.301696868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:31.035719828 +0000 UTC m=+26.744592644" watchObservedRunningTime="2026-09-17 14:05:31.037157309 +0000 UTC m=+26.746030125"
Sep 17 14:05:31.783206 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.783171    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:31.783378 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.783178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:31.783378 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:31.783310    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:31.783475 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:31.783372    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:31.986869 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.986822    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="61f565809b7c901a05c434a070419821cc392a9ea72128383c3334a3ec5e836b" exitCode=0
Sep 17 14:05:31.987425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.986882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"61f565809b7c901a05c434a070419821cc392a9ea72128383c3334a3ec5e836b"}
Sep 17 14:05:31.987425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.987359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:31.987572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.987436    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:31.987572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:31.987489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:32.005964 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.005917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:32.006144 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.006029    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:05:32.437725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.437692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-829tm"]
Sep 17 14:05:32.437921 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.437836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:32.437983 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:32.437949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:32.440367 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.440335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-brs66"]
Sep 17 14:05:32.440516 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.440455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:32.440598 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:32.440538    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:32.440783 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.440758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hw2kz"]
Sep 17 14:05:32.440866 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.440854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:32.440968 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:32.440946    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:32.991788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.991756    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="ab1abc8ba5978f9e8afbdb61c0dc265c716d6227aa29a33d1db07e51926b2ea6" exitCode=0
Sep 17 14:05:32.992525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:32.991842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"ab1abc8ba5978f9e8afbdb61c0dc265c716d6227aa29a33d1db07e51926b2ea6"}
Sep 17 14:05:33.782537 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:33.782492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:33.782731 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:33.782562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:33.782731 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:33.782653    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:33.782832 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:33.782787    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:34.783165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:34.782872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:34.783756 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:34.783214    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:35.783407 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:35.783289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:35.783856 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:35.783444    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:35.783856 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:35.783560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:35.783856 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:35.783655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:36.782440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:36.782355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:36.782616 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:36.782479    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw2kz" podUID="6eaa06e8-880d-46cc-87e6-5323583fee5f"
Sep 17 14:05:37.407823 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:37.407787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:37.408207 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:37.407849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:37.408207 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.407948    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:37.408207 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.407953    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:37.408207 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.408005    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret podName:169122e2-78b6-4046-8762-c339f73b10ec nodeName:}" failed. No retries permitted until 2026-09-17 14:06:09.407990133 +0000 UTC m=+65.116862927 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret") pod "global-pull-secret-syncer-brs66" (UID: "169122e2-78b6-4046-8762-c339f73b10ec") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:05:37.408207 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.408020    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs podName:d0587018-d1f7-457c-a4d8-fd91907bb935 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:09.408012604 +0000 UTC m=+65.116885397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs") pod "network-metrics-daemon-829tm" (UID: "d0587018-d1f7-457c-a4d8-fd91907bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:05:37.508692 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:37.508652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:37.508850 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.508827    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:05:37.508850 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.508850    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:05:37.508918 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.508860    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rjc5r for pod openshift-network-diagnostics/network-check-target-hw2kz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:37.508973 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.508917    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r podName:6eaa06e8-880d-46cc-87e6-5323583fee5f nodeName:}" failed. No retries permitted until 2026-09-17 14:06:09.508902494 +0000 UTC m=+65.217775288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rjc5r" (UniqueName: "kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r") pod "network-check-target-hw2kz" (UID: "6eaa06e8-880d-46cc-87e6-5323583fee5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:05:37.783314 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:37.783277    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:37.783480 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.783392    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brs66" podUID="169122e2-78b6-4046-8762-c339f73b10ec"
Sep 17 14:05:37.783480 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:37.783447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:37.783582 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:37.783544    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-829tm" podUID="d0587018-d1f7-457c-a4d8-fd91907bb935"
Sep 17 14:05:38.007571 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.007475    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="345c7a4e8efa2d8b5c72761723d80de6ac38d735ba7775132f34a8e805cb352d" exitCode=0
Sep 17 14:05:38.007571 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.007538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"345c7a4e8efa2d8b5c72761723d80de6ac38d735ba7775132f34a8e805cb352d"}
Sep 17 14:05:38.098997 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.098970    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-184.ec2.internal" event="NodeReady"
Sep 17 14:05:38.099149 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.099136    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 14:05:38.177568 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.177522    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q2wzm"]
Sep 17 14:05:38.191173 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.191145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vnl7z"]
Sep 17 14:05:38.191317 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.191192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.194381 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.194352    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 14:05:38.194609 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.194466    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hcwc9\""
Sep 17 14:05:38.194609 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.194363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 14:05:38.209145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.209106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2wzm"]
Sep 17 14:05:38.209145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.209151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnl7z"]
Sep 17 14:05:38.209383 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.209228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.211775 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.211744    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 14:05:38.211775 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.211762    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 14:05:38.211963 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.211807    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 14:05:38.212039 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.212021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-84cnx\""
Sep 17 14:05:38.315247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8eae9-31e1-4957-9980-4d3653a49cab-tmp-dir\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.315247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed8eae9-31e1-4957-9980-4d3653a49cab-config-volume\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.315435 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.315435 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88aa314-fdf6-4560-b730-4191a61b233d-cert\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.315435 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5mpr\" (UniqueName: \"kubernetes.io/projected/c88aa314-fdf6-4560-b730-4191a61b233d-kube-api-access-m5mpr\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.315435 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.315324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncq5\" (UniqueName: \"kubernetes.io/projected/6ed8eae9-31e1-4957-9980-4d3653a49cab-kube-api-access-dncq5\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.416300 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed8eae9-31e1-4957-9980-4d3653a49cab-config-volume\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88aa314-fdf6-4560-b730-4191a61b233d-cert\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mpr\" (UniqueName: \"kubernetes.io/projected/c88aa314-fdf6-4560-b730-4191a61b233d-kube-api-access-m5mpr\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncq5\" (UniqueName: \"kubernetes.io/projected/6ed8eae9-31e1-4957-9980-4d3653a49cab-kube-api-access-dncq5\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8eae9-31e1-4957-9980-4d3653a49cab-tmp-dir\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:38.416436    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:38.416601    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:05:38.916575793 +0000 UTC m=+34.625448603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:05:38.416786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ed8eae9-31e1-4957-9980-4d3653a49cab-tmp-dir\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.417138 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.416950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ed8eae9-31e1-4957-9980-4d3653a49cab-config-volume\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.420785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.420760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88aa314-fdf6-4560-b730-4191a61b233d-cert\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.428640 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.428615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5mpr\" (UniqueName: \"kubernetes.io/projected/c88aa314-fdf6-4560-b730-4191a61b233d-kube-api-access-m5mpr\") pod \"ingress-canary-vnl7z\" (UID: \"c88aa314-fdf6-4560-b730-4191a61b233d\") " pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.429915 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.429892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncq5\" (UniqueName: \"kubernetes.io/projected/6ed8eae9-31e1-4957-9980-4d3653a49cab-kube-api-access-dncq5\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.550127 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.550089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnl7z"
Sep 17 14:05:38.782922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.782745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:05:38.786038 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.786012    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 14:05:38.786213 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.786046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 14:05:38.786213 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.786117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkjmx\""
Sep 17 14:05:38.852993 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.852915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnl7z"]
Sep 17 14:05:38.857263 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:38.857234    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88aa314_fdf6_4560_b730_4191a61b233d.slice/crio-016248bd87f6aaa144b7c8409ddead8f86152fc2eeef673fab0c9c6867823dce WatchSource:0}: Error finding container 016248bd87f6aaa144b7c8409ddead8f86152fc2eeef673fab0c9c6867823dce: Status 404 returned error can't find the container with id 016248bd87f6aaa144b7c8409ddead8f86152fc2eeef673fab0c9c6867823dce
Sep 17 14:05:38.919859 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:38.919819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:38.920079 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:38.919940    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:38.920079 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:38.919998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:05:39.919978938 +0000 UTC m=+35.628851731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:05:39.013514 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.013472    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8d1479d-0939-409c-a686-b6e6cec125d7" containerID="0d5d401e59d957c9e1f53489f205e5f342dce520d6e88a32357c6e9578867328" exitCode=0
Sep 17 14:05:39.013795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.013568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerDied","Data":"0d5d401e59d957c9e1f53489f205e5f342dce520d6e88a32357c6e9578867328"}
Sep 17 14:05:39.017909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.017882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnl7z" event={"ID":"c88aa314-fdf6-4560-b730-4191a61b233d","Type":"ContainerStarted","Data":"016248bd87f6aaa144b7c8409ddead8f86152fc2eeef673fab0c9c6867823dce"}
Sep 17 14:05:39.783187 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.783152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:05:39.784033 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.783154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:05:39.786024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.785996    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 14:05:39.786170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.786000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 14:05:39.786170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.786004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27m2f\""
Sep 17 14:05:39.926502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:39.926461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:39.926723 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:39.926704    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:39.926785 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:39.926780    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:05:41.926761212 +0000 UTC m=+37.635634029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:05:40.025321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:40.025278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" event={"ID":"b8d1479d-0939-409c-a686-b6e6cec125d7","Type":"ContainerStarted","Data":"5ca38bf48df88b9c36c721615f0f22fb90965696b10d7880aae8735827e9513d"}
Sep 17 14:05:40.051926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:40.051781    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rg2zs" podStartSLOduration=6.64162097 podStartE2EDuration="36.051761046s" totalImagesPullingTime="29.410140076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:40.050266571 +0000 UTC m=+35.759139387" watchObservedRunningTime="2026-09-17 14:05:40.051761046 +0000 UTC m=+35.760633861"
Sep 17 14:05:41.944968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:41.944932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:41.945423 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:41.945075    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:41.945423 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:41.945178    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:05:45.945156945 +0000 UTC m=+41.654029750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:05:42.032618 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:42.032585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnl7z" event={"ID":"c88aa314-fdf6-4560-b730-4191a61b233d","Type":"ContainerStarted","Data":"296eaf56c982a772d1751466fead76c1d2725787666a4afaf2b95aeda9709ab0"}
Sep 17 14:05:42.054525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:42.054471    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vnl7z" podStartSLOduration=1.682231673 podStartE2EDuration="4.054451591s" totalImagesPullingTime="2.372219918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:42.054270992 +0000 UTC m=+37.763143808" watchObservedRunningTime="2026-09-17 14:05:42.054451591 +0000 UTC m=+37.763324407"
Sep 17 14:05:44.385451 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.385262    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rr7jk"]
Sep 17 14:05:44.404507 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.404478    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rr7jk"]
Sep 17 14:05:44.404672 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.404609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.407526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.407496    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-48lqt\""
Sep 17 14:05:44.407697 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.407521    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 14:05:44.407851 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.407834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 14:05:44.408231 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.408216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 14:05:44.408294 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.408281    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 14:05:44.485611 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.485574    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"]
Sep 17 14:05:44.506011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.505977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"]
Sep 17 14:05:44.506193 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.506113    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"
Sep 17 14:05:44.508795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.508771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 14:05:44.508934 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.508846    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8d678\""
Sep 17 14:05:44.508934 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.508863    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 14:05:44.563995 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.563960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c10dd-29b8-4acd-87ca-8ef2570c3371-crio-socket\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.563995 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.563994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c10dd-29b8-4acd-87ca-8ef2570c3371-data-volume\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.564222 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.564038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.564222 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.564057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzncc\" (UniqueName: \"kubernetes.io/projected/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-api-access-nzncc\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.564222 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.564078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665095 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665095 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzncc\" (UniqueName: \"kubernetes.io/projected/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-api-access-nzncc\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665095 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:44.665152    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:44.665176    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:44.665210    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:45.165191195 +0000 UTC m=+40.874064018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : configmap "kube-rbac-proxy" not found
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrct6\" (UniqueName: \"kubernetes.io/projected/03835140-1092-453a-90d3-c4641180c2fa-kube-api-access-lrct6\") pod \"migrator-8b4d697c5-65x57\" (UID: \"03835140-1092-453a-90d3-c4641180c2fa\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:44.665238    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:45.165220541 +0000 UTC m=+40.874093350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c10dd-29b8-4acd-87ca-8ef2570c3371-crio-socket\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c10dd-29b8-4acd-87ca-8ef2570c3371-data-volume\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665716 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/642c10dd-29b8-4acd-87ca-8ef2570c3371-crio-socket\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.665716 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.665614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/642c10dd-29b8-4acd-87ca-8ef2570c3371-data-volume\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.674313 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.674291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzncc\" (UniqueName: \"kubernetes.io/projected/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-api-access-nzncc\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:44.766483 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.766445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrct6\" (UniqueName: \"kubernetes.io/projected/03835140-1092-453a-90d3-c4641180c2fa-kube-api-access-lrct6\") pod \"migrator-8b4d697c5-65x57\" (UID: \"03835140-1092-453a-90d3-c4641180c2fa\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"
Sep 17 14:05:44.775614 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.775583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrct6\" (UniqueName: \"kubernetes.io/projected/03835140-1092-453a-90d3-c4641180c2fa-kube-api-access-lrct6\") pod \"migrator-8b4d697c5-65x57\" (UID: \"03835140-1092-453a-90d3-c4641180c2fa\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"
Sep 17 14:05:44.814765 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:44.814721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"
Sep 17 14:05:45.119393 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:45.119360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57"]
Sep 17 14:05:45.123234 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:45.123193    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03835140_1092_453a_90d3_c4641180c2fa.slice/crio-c597b59214b8a4e8b5e0cc49760f4f5a8c59a6ac919227002b635d08ba4fd184 WatchSource:0}: Error finding container c597b59214b8a4e8b5e0cc49760f4f5a8c59a6ac919227002b635d08ba4fd184: Status 404 returned error can't find the container with id c597b59214b8a4e8b5e0cc49760f4f5a8c59a6ac919227002b635d08ba4fd184
Sep 17 14:05:45.171161 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:45.171123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:45.171161 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:45.171162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:45.171360 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.171230    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:05:45.171360 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.171272    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:45.171360 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.171285    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:46.171271278 +0000 UTC m=+41.880144071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : configmap "kube-rbac-proxy" not found
Sep 17 14:05:45.171360 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.171327    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:46.171312949 +0000 UTC m=+41.880185742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:45.977454 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:45.977414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:45.977857 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.977573    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:45.977857 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:45.977690    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:05:53.977666669 +0000 UTC m=+49.686539477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:05:46.043697 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.043656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57" event={"ID":"03835140-1092-453a-90d3-c4641180c2fa","Type":"ContainerStarted","Data":"c597b59214b8a4e8b5e0cc49760f4f5a8c59a6ac919227002b635d08ba4fd184"}
Sep 17 14:05:46.092585 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.092529    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2bcx_18f540d4-9be9-4dd8-84e6-fe034aeb9123/dns-node-resolver/0.log"
Sep 17 14:05:46.179260 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.179222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:46.179421 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.179278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:46.179421 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:46.179394    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:46.179421 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:46.179412    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:05:46.179604 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:46.179488    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:48.179465994 +0000 UTC m=+43.888338788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:46.179604 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:46.179515    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:48.179504688 +0000 UTC m=+43.888377482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : configmap "kube-rbac-proxy" not found
Sep 17 14:05:46.934163 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.934129    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bfhjq"]
Sep 17 14:05:46.957052 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.957023    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bfhjq"]
Sep 17 14:05:46.957194 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.957133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:46.960211 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.960187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 14:05:46.960355 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.960335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 14:05:46.961389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.961365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4hfb7\""
Sep 17 14:05:46.961389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.961371    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 14:05:46.961541 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:46.961412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 14:05:47.048659 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.048568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57" event={"ID":"03835140-1092-453a-90d3-c4641180c2fa","Type":"ContainerStarted","Data":"726bade50908628fb853a0b3e7557b589ee0a665f7827c537b12b916f61bafcc"}
Sep 17 14:05:47.048659 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.048624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57" event={"ID":"03835140-1092-453a-90d3-c4641180c2fa","Type":"ContainerStarted","Data":"3d8ae3ebaa0898bea322a1ac401801348dc98f483c465d51fc9580870f587a84"}
Sep 17 14:05:47.079398 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.079340    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-65x57" podStartSLOduration=1.41462916 podStartE2EDuration="3.079321676s" totalImagesPullingTime="1.664692516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:47.078268644 +0000 UTC m=+42.787141462" watchObservedRunningTime="2026-09-17 14:05:47.079321676 +0000 UTC m=+42.788194492"
Sep 17 14:05:47.086897 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.086859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-key\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.086897 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.086897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bf9\" (UniqueName: \"kubernetes.io/projected/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-kube-api-access-d9bf9\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.087111 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.086932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-cabundle\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.187504 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.187464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-key\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.187504 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.187513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bf9\" (UniqueName: \"kubernetes.io/projected/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-kube-api-access-d9bf9\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.187779 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.187600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-cabundle\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.188296 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.188273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-cabundle\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.190005 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.189986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-signing-key\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.196483 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.196455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bf9\" (UniqueName: \"kubernetes.io/projected/f7dd00d0-9679-45c2-91cf-6ac6675d66a3-kube-api-access-d9bf9\") pod \"service-ca-568869fdc5-bfhjq\" (UID: \"f7dd00d0-9679-45c2-91cf-6ac6675d66a3\") " pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.278646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.278605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bfhjq"
Sep 17 14:05:47.493291 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.493262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v69kn_4bde3f45-ccec-4cde-9123-ee6a980dda9b/node-ca/0.log"
Sep 17 14:05:47.583061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:47.582984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bfhjq"]
Sep 17 14:05:47.585976 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:05:47.585949    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7dd00d0_9679_45c2_91cf_6ac6675d66a3.slice/crio-ab6a53a892878a6db048a58b35d6f2ada0c60eb35326751f2bee10b5b2a98bac WatchSource:0}: Error finding container ab6a53a892878a6db048a58b35d6f2ada0c60eb35326751f2bee10b5b2a98bac: Status 404 returned error can't find the container with id ab6a53a892878a6db048a58b35d6f2ada0c60eb35326751f2bee10b5b2a98bac
Sep 17 14:05:48.052559 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:48.052525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bfhjq" event={"ID":"f7dd00d0-9679-45c2-91cf-6ac6675d66a3","Type":"ContainerStarted","Data":"ab6a53a892878a6db048a58b35d6f2ada0c60eb35326751f2bee10b5b2a98bac"}
Sep 17 14:05:48.092520 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:48.092492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnl7z_c88aa314-fdf6-4560-b730-4191a61b233d/serve-healthcheck-canary/0.log"
Sep 17 14:05:48.196564 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:48.196508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:48.196756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:48.196581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:48.196756 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:48.196691    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:48.196756 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:48.196708    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:05:48.196934 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:48.196781    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:52.196749654 +0000 UTC m=+47.905622453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:48.196934 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:48.196804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:05:52.196793912 +0000 UTC m=+47.905666710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : configmap "kube-rbac-proxy" not found
Sep 17 14:05:50.059656 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:50.059615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bfhjq" event={"ID":"f7dd00d0-9679-45c2-91cf-6ac6675d66a3","Type":"ContainerStarted","Data":"d80164c86b17ca955b418f5b0dc69735066c00c3c76031c4316381f911010214"}
Sep 17 14:05:50.092738 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:50.092614    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-bfhjq" podStartSLOduration=1.841236598 podStartE2EDuration="4.092591794s" totalImagesPullingTime="2.251355196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:05:50.091296079 +0000 UTC m=+45.800168895" watchObservedRunningTime="2026-09-17 14:05:50.092591794 +0000 UTC m=+45.801464612"
Sep 17 14:05:52.231160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:52.231117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:52.231160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:52.231173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:52.231706 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:52.231309    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:52.231706 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:52.231395    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls podName:642c10dd-29b8-4acd-87ca-8ef2570c3371 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:00.231372773 +0000 UTC m=+55.940245573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rr7jk" (UID: "642c10dd-29b8-4acd-87ca-8ef2570c3371") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:05:52.231828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:52.231808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/642c10dd-29b8-4acd-87ca-8ef2570c3371-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:05:54.046542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:05:54.046500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:05:54.047005 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:54.046658    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:05:54.047005 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:05:54.046727    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls podName:6ed8eae9-31e1-4957-9980-4d3653a49cab nodeName:}" failed. No retries permitted until 2026-09-17 14:06:10.046710918 +0000 UTC m=+65.755583719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls") pod "dns-default-q2wzm" (UID: "6ed8eae9-31e1-4957-9980-4d3653a49cab") : secret "dns-default-metrics-tls" not found
Sep 17 14:06:00.296513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:00.296473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:06:00.298952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:00.298926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/642c10dd-29b8-4acd-87ca-8ef2570c3371-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rr7jk\" (UID: \"642c10dd-29b8-4acd-87ca-8ef2570c3371\") " pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:06:00.314950 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:00.314909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rr7jk"
Sep 17 14:06:00.596188 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:00.596092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rr7jk"]
Sep 17 14:06:00.600607 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:00.600581    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642c10dd_29b8_4acd_87ca_8ef2570c3371.slice/crio-1f4951273ca44396d28c84858dbae9019217134bcf378432affc72cf537bfe39 WatchSource:0}: Error finding container 1f4951273ca44396d28c84858dbae9019217134bcf378432affc72cf537bfe39: Status 404 returned error can't find the container with id 1f4951273ca44396d28c84858dbae9019217134bcf378432affc72cf537bfe39
Sep 17 14:06:01.090964 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:01.090925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr7jk" event={"ID":"642c10dd-29b8-4acd-87ca-8ef2570c3371","Type":"ContainerStarted","Data":"2f6ef9d0168c44561193f3c3cbb26c58ab3c350b1fdbd4355a1c18ebc0991cf0"}
Sep 17 14:06:01.091188 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:01.090985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr7jk" event={"ID":"642c10dd-29b8-4acd-87ca-8ef2570c3371","Type":"ContainerStarted","Data":"1f4951273ca44396d28c84858dbae9019217134bcf378432affc72cf537bfe39"}
Sep 17 14:06:02.097502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:02.097462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr7jk" event={"ID":"642c10dd-29b8-4acd-87ca-8ef2570c3371","Type":"ContainerStarted","Data":"23a2243c9d70385fa86356c7d42ed73149346a43e0078572d4e14126be26c9a8"}
Sep 17 14:06:04.005541 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:04.005513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk9qc"
Sep 17 14:06:04.108828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:04.108792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rr7jk" event={"ID":"642c10dd-29b8-4acd-87ca-8ef2570c3371","Type":"ContainerStarted","Data":"ddd59067492b42a1668b929ddaf042ec6e6217158dab874bfc38137008b8ba05"}
Sep 17 14:06:04.130601 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:04.130526    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rr7jk" podStartSLOduration=17.493048161 podStartE2EDuration="20.130504765s" totalImagesPullingTime="2.637456604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:04.129746527 +0000 UTC m=+59.838619362" watchObservedRunningTime="2026-09-17 14:06:04.130504765 +0000 UTC m=+59.839377581"
Sep 17 14:06:09.460994 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.460945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:06:09.461395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.461123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:06:09.464399 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.464372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 14:06:09.465253 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.465233    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 14:06:09.474267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.474229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/169122e2-78b6-4046-8762-c339f73b10ec-original-pull-secret\") pod \"global-pull-secret-syncer-brs66\" (UID: \"169122e2-78b6-4046-8762-c339f73b10ec\") " pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:06:09.474267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.474249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0587018-d1f7-457c-a4d8-fd91907bb935-metrics-certs\") pod \"network-metrics-daemon-829tm\" (UID: \"d0587018-d1f7-457c-a4d8-fd91907bb935\") " pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:06:09.495334 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.495295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brs66"
Sep 17 14:06:09.504646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.504624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27m2f\""
Sep 17 14:06:09.511508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.511470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-829tm"
Sep 17 14:06:09.562227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.561827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:06:09.567079 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.567025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 14:06:09.576038 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.575997    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 14:06:09.586145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.586111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjc5r\" (UniqueName: \"kubernetes.io/projected/6eaa06e8-880d-46cc-87e6-5323583fee5f-kube-api-access-rjc5r\") pod \"network-check-target-hw2kz\" (UID: \"6eaa06e8-880d-46cc-87e6-5323583fee5f\") " pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:06:09.695663 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.695631    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkjmx\""
Sep 17 14:06:09.703166 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.703136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:06:09.782525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.782134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-brs66"]
Sep 17 14:06:09.785014 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:09.784983    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169122e2_78b6_4046_8762_c339f73b10ec.slice/crio-8cedecbc74e8edcd681e6c2f3ef29eb97cd99aae741a5c19c607d52d26d1084a WatchSource:0}: Error finding container 8cedecbc74e8edcd681e6c2f3ef29eb97cd99aae741a5c19c607d52d26d1084a: Status 404 returned error can't find the container with id 8cedecbc74e8edcd681e6c2f3ef29eb97cd99aae741a5c19c607d52d26d1084a
Sep 17 14:06:09.808628 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.808530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-829tm"]
Sep 17 14:06:09.812187 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:09.812157    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0587018_d1f7_457c_a4d8_fd91907bb935.slice/crio-1394e3e43f3ad04d2929d61f2d1e70b2481f1e266844fa848b11cac36f2df394 WatchSource:0}: Error finding container 1394e3e43f3ad04d2929d61f2d1e70b2481f1e266844fa848b11cac36f2df394: Status 404 returned error can't find the container with id 1394e3e43f3ad04d2929d61f2d1e70b2481f1e266844fa848b11cac36f2df394
Sep 17 14:06:09.993252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:09.993165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hw2kz"]
Sep 17 14:06:09.996157 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:09.996126    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eaa06e8_880d_46cc_87e6_5323583fee5f.slice/crio-f84ca823a9e8ff6494adfba88248490aa2726c516c8eb6d74b6dd686db3f51a6 WatchSource:0}: Error finding container f84ca823a9e8ff6494adfba88248490aa2726c516c8eb6d74b6dd686db3f51a6: Status 404 returned error can't find the container with id f84ca823a9e8ff6494adfba88248490aa2726c516c8eb6d74b6dd686db3f51a6
Sep 17 14:06:10.065497 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.065453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:06:10.067871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.067841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ed8eae9-31e1-4957-9980-4d3653a49cab-metrics-tls\") pod \"dns-default-q2wzm\" (UID: \"6ed8eae9-31e1-4957-9980-4d3653a49cab\") " pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:06:10.128928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.128891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hw2kz" event={"ID":"6eaa06e8-880d-46cc-87e6-5323583fee5f","Type":"ContainerStarted","Data":"f84ca823a9e8ff6494adfba88248490aa2726c516c8eb6d74b6dd686db3f51a6"}
Sep 17 14:06:10.130079 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.130045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-829tm" event={"ID":"d0587018-d1f7-457c-a4d8-fd91907bb935","Type":"ContainerStarted","Data":"1394e3e43f3ad04d2929d61f2d1e70b2481f1e266844fa848b11cac36f2df394"}
Sep 17 14:06:10.131249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.131224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-brs66" event={"ID":"169122e2-78b6-4046-8762-c339f73b10ec","Type":"ContainerStarted","Data":"8cedecbc74e8edcd681e6c2f3ef29eb97cd99aae741a5c19c607d52d26d1084a"}
Sep 17 14:06:10.348779 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.348694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hcwc9\""
Sep 17 14:06:10.355888 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.355861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:06:10.674510 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.674339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q2wzm"]
Sep 17 14:06:10.682532 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:10.682487    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed8eae9_31e1_4957_9980_4d3653a49cab.slice/crio-c36663ef4c3ebbc933168fd3f0619fafe31946ee921527b1cae2d69efca7115d WatchSource:0}: Error finding container c36663ef4c3ebbc933168fd3f0619fafe31946ee921527b1cae2d69efca7115d: Status 404 returned error can't find the container with id c36663ef4c3ebbc933168fd3f0619fafe31946ee921527b1cae2d69efca7115d
Sep 17 14:06:10.727066 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.726374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"]
Sep 17 14:06:10.729700 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.729032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.732877 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.732845    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 14:06:10.733947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.733669    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 14:06:10.733947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.733681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 14:06:10.733947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.733725    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 14:06:10.733947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.733669    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 14:06:10.733947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.733883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 14:06:10.736804 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.736776    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 14:06:10.769565 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.769757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.769757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.769757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkwq\" (UniqueName: \"kubernetes.io/projected/800c5720-9448-4990-a4fb-4525c9de7fb1-kube-api-access-fmkwq\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.769757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.769757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.769750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/800c5720-9448-4990-a4fb-4525c9de7fb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.782187 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.782152    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"]
Sep 17 14:06:10.870972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.870857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.870972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.870909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.870972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.870946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.871267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.870989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkwq\" (UniqueName: \"kubernetes.io/projected/800c5720-9448-4990-a4fb-4525c9de7fb1-kube-api-access-fmkwq\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.871267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.871026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.871267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.871047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/800c5720-9448-4990-a4fb-4525c9de7fb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.871948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.871921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/800c5720-9448-4990-a4fb-4525c9de7fb1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.875507 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.874713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-ca\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.875507 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.875460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.877154 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.877096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.877442 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.877403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/800c5720-9448-4990-a4fb-4525c9de7fb1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:10.898485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:10.897523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkwq\" (UniqueName: \"kubernetes.io/projected/800c5720-9448-4990-a4fb-4525c9de7fb1-kube-api-access-fmkwq\") pod \"cluster-proxy-proxy-agent-6954f648-dckcw\" (UID: \"800c5720-9448-4990-a4fb-4525c9de7fb1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:11.051762 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:11.051717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"
Sep 17 14:06:11.151089 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:11.141452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2wzm" event={"ID":"6ed8eae9-31e1-4957-9980-4d3653a49cab","Type":"ContainerStarted","Data":"c36663ef4c3ebbc933168fd3f0619fafe31946ee921527b1cae2d69efca7115d"}
Sep 17 14:06:11.392761 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:11.392717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw"]
Sep 17 14:06:11.400300 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:11.399685    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod800c5720_9448_4990_a4fb_4525c9de7fb1.slice/crio-690e75533e246f81c325f54ef42dadd9fd4ba3cd6bf2af1a6b3ba5c3dbe59144 WatchSource:0}: Error finding container 690e75533e246f81c325f54ef42dadd9fd4ba3cd6bf2af1a6b3ba5c3dbe59144: Status 404 returned error can't find the container with id 690e75533e246f81c325f54ef42dadd9fd4ba3cd6bf2af1a6b3ba5c3dbe59144
Sep 17 14:06:12.152674 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:12.152599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-829tm" event={"ID":"d0587018-d1f7-457c-a4d8-fd91907bb935","Type":"ContainerStarted","Data":"5c9bafdd721b97658ff17ff465954c1a68c633bcce8a4839a790cc967876fe7d"}
Sep 17 14:06:12.153150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:12.152713    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-829tm" event={"ID":"d0587018-d1f7-457c-a4d8-fd91907bb935","Type":"ContainerStarted","Data":"58576e8c0e138f5332d29f85c720e299fbe0e375744a3f7cb4afd77e455226ec"}
Sep 17 14:06:12.155759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:12.155675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw" event={"ID":"800c5720-9448-4990-a4fb-4525c9de7fb1","Type":"ContainerStarted","Data":"690e75533e246f81c325f54ef42dadd9fd4ba3cd6bf2af1a6b3ba5c3dbe59144"}
Sep 17 14:06:12.196842 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:12.196566    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-829tm" podStartSLOduration=66.882523004 podStartE2EDuration="1m8.196518207s" totalImagesPullingTime="1.313995203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:12.192122608 +0000 UTC m=+67.900995447" watchObservedRunningTime="2026-09-17 14:06:12.196518207 +0000 UTC m=+67.905391024"
Sep 17 14:06:18.180844 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.180805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw" event={"ID":"800c5720-9448-4990-a4fb-4525c9de7fb1","Type":"ContainerStarted","Data":"40725f2a8f8334dc1be592e2979629044d0728d77af956ddf12c33cdd7670e56"}
Sep 17 14:06:18.181312 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.180860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw" event={"ID":"800c5720-9448-4990-a4fb-4525c9de7fb1","Type":"ContainerStarted","Data":"d34ae1c34579cc7f689d327cdb390ca5cbd264bb944b06400d65e7d1c0e2572e"}
Sep 17 14:06:18.181312 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.180876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw" event={"ID":"800c5720-9448-4990-a4fb-4525c9de7fb1","Type":"ContainerStarted","Data":"9376db973b0a9158e703ebeecfab417c24509136682ac8367092367db4dc92ca"}
Sep 17 14:06:18.182241 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.182215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-brs66" event={"ID":"169122e2-78b6-4046-8762-c339f73b10ec","Type":"ContainerStarted","Data":"8d4a15704225776f55ad525414a40abacce0e1d52966299d9958ff1a2f0311a9"}
Sep 17 14:06:18.184087 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.184063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hw2kz" event={"ID":"6eaa06e8-880d-46cc-87e6-5323583fee5f","Type":"ContainerStarted","Data":"4e57fa21f1ce9dd8acedc867b81a3d5a98c89a48edf0a928ee8a95d22d9b0129"}
Sep 17 14:06:18.184208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.184184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:06:18.185619 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.185597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2wzm" event={"ID":"6ed8eae9-31e1-4957-9980-4d3653a49cab","Type":"ContainerStarted","Data":"cccebbb81fcddf5e41b3d9fcf0d9ac81511fadd362fa8b2bad6fcf18def24e48"}
Sep 17 14:06:18.185706 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.185632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q2wzm" event={"ID":"6ed8eae9-31e1-4957-9980-4d3653a49cab","Type":"ContainerStarted","Data":"bea96f717fc3865c613cfd5e1f8ff4064e53a6402b70bfa3fd90c857362ce23c"}
Sep 17 14:06:18.185750 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.185721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:06:18.209218 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.209163    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6954f648-dckcw" podStartSLOduration=2.172192938 podStartE2EDuration="8.209147723s" totalImagesPullingTime="6.036954785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:18.209028875 +0000 UTC m=+73.917901700" watchObservedRunningTime="2026-09-17 14:06:18.209147723 +0000 UTC m=+73.918020538"
Sep 17 14:06:18.241620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.239778    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q2wzm" podStartSLOduration=33.514381481 podStartE2EDuration="40.239756295s" totalImagesPullingTime="6.725374814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:18.238254046 +0000 UTC m=+73.947126863" watchObservedRunningTime="2026-09-17 14:06:18.239756295 +0000 UTC m=+73.948629113"
Sep 17 14:06:18.258976 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.258907    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-brs66" podStartSLOduration=66.614832126 podStartE2EDuration="1m14.258884221s" totalImagesPullingTime="7.644052095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:18.257885547 +0000 UTC m=+73.966758362" watchObservedRunningTime="2026-09-17 14:06:18.258884221 +0000 UTC m=+73.967757038"
Sep 17 14:06:18.279705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.279650    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hw2kz" podStartSLOduration=66.861865012 podStartE2EDuration="1m14.279629676s" totalImagesPullingTime="7.417764664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:18.278199028 +0000 UTC m=+73.987071845" watchObservedRunningTime="2026-09-17 14:06:18.279629676 +0000 UTC m=+73.988502492"
Sep 17 14:06:18.795416 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.795375    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"]
Sep 17 14:06:18.798525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.798505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:18.801446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.801409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 14:06:18.801660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.801513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 14:06:18.801660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.801520    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 14:06:18.801800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.801785    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 14:06:18.802812 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.802780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 14:06:18.802919 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.802866    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pgxwg\""
Sep 17 14:06:18.816528 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.816488    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"]
Sep 17 14:06:18.933145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.933102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldbv\" (UniqueName: \"kubernetes.io/projected/cc8fe592-3a5c-4137-af65-6f3fce1c273b-kube-api-access-fldbv\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:18.933145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.933146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8fe592-3a5c-4137-af65-6f3fce1c273b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:18.933347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.933186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:18.933347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:18.933203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.034215 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.034171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.034215 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.034211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.034437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.034256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldbv\" (UniqueName: \"kubernetes.io/projected/cc8fe592-3a5c-4137-af65-6f3fce1c273b-kube-api-access-fldbv\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.034437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.034294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8fe592-3a5c-4137-af65-6f3fce1c273b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.035083 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.035060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc8fe592-3a5c-4137-af65-6f3fce1c273b-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.036725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.036697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.036826 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.036772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc8fe592-3a5c-4137-af65-6f3fce1c273b-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.046183 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.046110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldbv\" (UniqueName: \"kubernetes.io/projected/cc8fe592-3a5c-4137-af65-6f3fce1c273b-kube-api-access-fldbv\") pod \"prometheus-operator-68bcd7f987-pvsbn\" (UID: \"cc8fe592-3a5c-4137-af65-6f3fce1c273b\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.109200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.109162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"
Sep 17 14:06:19.391171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:19.391145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn"]
Sep 17 14:06:19.393673 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:19.393649    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8fe592_3a5c_4137_af65_6f3fce1c273b.slice/crio-822db68dba712a482fe2471084699fa373b3aad953a504407f1b12a9689194a6 WatchSource:0}: Error finding container 822db68dba712a482fe2471084699fa373b3aad953a504407f1b12a9689194a6: Status 404 returned error can't find the container with id 822db68dba712a482fe2471084699fa373b3aad953a504407f1b12a9689194a6
Sep 17 14:06:20.196078 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:20.196041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn" event={"ID":"cc8fe592-3a5c-4137-af65-6f3fce1c273b","Type":"ContainerStarted","Data":"822db68dba712a482fe2471084699fa373b3aad953a504407f1b12a9689194a6"}
Sep 17 14:06:21.201463 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:21.201426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn" event={"ID":"cc8fe592-3a5c-4137-af65-6f3fce1c273b","Type":"ContainerStarted","Data":"f88dd836102ab6658f5c57a0e45e0b4061847cbd242eb10277bd32eab81f22d1"}
Sep 17 14:06:21.201959 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:21.201483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn" event={"ID":"cc8fe592-3a5c-4137-af65-6f3fce1c273b","Type":"ContainerStarted","Data":"23ca9a3e518b02c8efd8beb00aef3e7f801431290cda73cc17d9f903e7cd6ce3"}
Sep 17 14:06:21.226854 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:21.226784    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-pvsbn" podStartSLOduration=1.938836137 podStartE2EDuration="3.226759701s" totalImagesPullingTime="1.287923564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:21.223498813 +0000 UTC m=+76.932371628" watchObservedRunningTime="2026-09-17 14:06:21.226759701 +0000 UTC m=+76.935632519"
Sep 17 14:06:23.309237 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.309193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m5s69"]
Sep 17 14:06:23.311968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.311927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.325885 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.325855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 14:06:23.326158 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.325924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 14:06:23.326239 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.325946    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 14:06:23.326300 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.326030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5jnvg\""
Sep 17 14:06:23.368813 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47xbw\" (UniqueName: \"kubernetes.io/projected/1713b64e-53d3-4c6f-a5df-b5e77767731d-kube-api-access-47xbw\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-root\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-metrics-client-ca\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.368960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.369014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-textfile\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.369065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-sys\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.369276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.369094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-wtmp\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-sys\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-wtmp\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47xbw\" (UniqueName: \"kubernetes.io/projected/1713b64e-53d3-4c6f-a5df-b5e77767731d-kube-api-access-47xbw\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-root\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-sys\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-root\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:06:23.469685    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-wtmp\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:06:23.469746    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls podName:1713b64e-53d3-4c6f-a5df-b5e77767731d nodeName:}" failed. No retries permitted until 2026-09-17 14:06:23.969725996 +0000 UTC m=+79.678598792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls") pod "node-exporter-m5s69" (UID: "1713b64e-53d3-4c6f-a5df-b5e77767731d") : secret "node-exporter-tls" not found
Sep 17 14:06:23.469755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-metrics-client-ca\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.470249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.470249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.469830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-textfile\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.470249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.470199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-textfile\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.470407 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.470366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.470407 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.470369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1713b64e-53d3-4c6f-a5df-b5e77767731d-metrics-client-ca\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.472656 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.472625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.481759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.481733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47xbw\" (UniqueName: \"kubernetes.io/projected/1713b64e-53d3-4c6f-a5df-b5e77767731d-kube-api-access-47xbw\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.973703 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.973666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:23.976242 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:23.976202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1713b64e-53d3-4c6f-a5df-b5e77767731d-node-exporter-tls\") pod \"node-exporter-m5s69\" (UID: \"1713b64e-53d3-4c6f-a5df-b5e77767731d\") " pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:24.224569 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:24.224453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5s69"
Sep 17 14:06:24.236382 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:24.236345    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1713b64e_53d3_4c6f_a5df_b5e77767731d.slice/crio-7eb0d3559b5f00521a2561ed20cd799840a368ef012ba47b9584aae8914524e8 WatchSource:0}: Error finding container 7eb0d3559b5f00521a2561ed20cd799840a368ef012ba47b9584aae8914524e8: Status 404 returned error can't find the container with id 7eb0d3559b5f00521a2561ed20cd799840a368ef012ba47b9584aae8914524e8
Sep 17 14:06:25.220476 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:25.220436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5s69" event={"ID":"1713b64e-53d3-4c6f-a5df-b5e77767731d","Type":"ContainerStarted","Data":"7eb0d3559b5f00521a2561ed20cd799840a368ef012ba47b9584aae8914524e8"}
Sep 17 14:06:26.226151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:26.226106    2560 generic.go:356] "Generic (PLEG): container finished" podID="1713b64e-53d3-4c6f-a5df-b5e77767731d" containerID="c497c6465a4a33114be5d146bc50096ad3b02a8a08db5b735f5988f64e767b68" exitCode=0
Sep 17 14:06:26.226609 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:26.226205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5s69" event={"ID":"1713b64e-53d3-4c6f-a5df-b5e77767731d","Type":"ContainerDied","Data":"c497c6465a4a33114be5d146bc50096ad3b02a8a08db5b735f5988f64e767b68"}
Sep 17 14:06:27.231820 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:27.231778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5s69" event={"ID":"1713b64e-53d3-4c6f-a5df-b5e77767731d","Type":"ContainerStarted","Data":"782ce49e8523296ff8254a272534e8959dbd83e527170b50eca5d9844db38863"}
Sep 17 14:06:27.232299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:27.231834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5s69" event={"ID":"1713b64e-53d3-4c6f-a5df-b5e77767731d","Type":"ContainerStarted","Data":"43c167960fe8dab90a706fe90d55296b9633fcf2b545bfd4eab23b917e3a3a59"}
Sep 17 14:06:28.193696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:28.193662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q2wzm"
Sep 17 14:06:28.227777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:28.227716    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m5s69" podStartSLOduration=4.206347039 podStartE2EDuration="5.227695897s" totalImagesPullingTime="950.314443ms" totalInitContainerRuntime="71.034415ms" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:27.295487485 +0000 UTC m=+83.004360321" watchObservedRunningTime="2026-09-17 14:06:28.227695897 +0000 UTC m=+83.936568715"
Sep 17 14:06:41.817115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.817078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:06:41.820216 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.820196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.824425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.824398    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 14:06:41.824719 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.824703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 14:06:41.825179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.825164    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nwvjf\""
Sep 17 14:06:41.825621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.825603    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 14:06:41.825863 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.825795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 14:06:41.825863 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.825808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 14:06:41.826006 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.825884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 14:06:41.826157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.826141    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 14:06:41.836525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.836492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:06:41.908313 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.908500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.908500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7ww\" (UniqueName: \"kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.908500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.908500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:41.908678 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:41.908516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.009915 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.009875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.009915 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.009918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.010180 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.010180 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.010180 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ww\" (UniqueName: \"kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.010333 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.010893 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.011012 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.010867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.011334 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.011311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.012513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.012489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.012673 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.012490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.019957 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.019930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7ww\" (UniqueName: \"kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww\") pod \"console-687d69548d-4bfmz\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") " pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.131682 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.131585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:42.415243 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:42.415219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:06:42.417914 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:06:42.417885    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8842ac_393d_4c08_9209_042c729d1f17.slice/crio-e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6 WatchSource:0}: Error finding container e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6: Status 404 returned error can't find the container with id e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6
Sep 17 14:06:43.290908 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:43.290866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d69548d-4bfmz" event={"ID":"3d8842ac-393d-4c08-9209-042c729d1f17","Type":"ContainerStarted","Data":"e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6"}
Sep 17 14:06:47.307358 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:47.307314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d69548d-4bfmz" event={"ID":"3d8842ac-393d-4c08-9209-042c729d1f17","Type":"ContainerStarted","Data":"dd498c4df1dd5749b9befa199b7603cb7a276d3a046b3ba61f18855ff1bbb8d2"}
Sep 17 14:06:47.355347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:47.355285    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687d69548d-4bfmz" podStartSLOduration=1.867029109 podStartE2EDuration="6.355261109s" totalImagesPullingTime="4.488232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:47.355039819 +0000 UTC m=+103.063912638" watchObservedRunningTime="2026-09-17 14:06:47.355261109 +0000 UTC m=+103.064133985"
Sep 17 14:06:49.193443 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:49.193414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hw2kz"
Sep 17 14:06:52.131823 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:52.131779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:52.132256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:52.131869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:52.136966 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:52.136935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:06:52.329385 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:06:52.329355    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:07:01.194213 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:01.194177    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:07:26.213630 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.213541    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-687d69548d-4bfmz" podUID="3d8842ac-393d-4c08-9209-042c729d1f17" containerName="console" containerID="cri-o://dd498c4df1dd5749b9befa199b7603cb7a276d3a046b3ba61f18855ff1bbb8d2" gracePeriod=15
Sep 17 14:07:26.440186 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.440150    2560 generic.go:356] "Generic (PLEG): container finished" podID="3d8842ac-393d-4c08-9209-042c729d1f17" containerID="dd498c4df1dd5749b9befa199b7603cb7a276d3a046b3ba61f18855ff1bbb8d2" exitCode=0
Sep 17 14:07:26.440306 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.440215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d69548d-4bfmz" event={"ID":"3d8842ac-393d-4c08-9209-042c729d1f17","Type":"ContainerDied","Data":"dd498c4df1dd5749b9befa199b7603cb7a276d3a046b3ba61f18855ff1bbb8d2"}
Sep 17 14:07:26.440306 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.440273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687d69548d-4bfmz" event={"ID":"3d8842ac-393d-4c08-9209-042c729d1f17","Type":"ContainerDied","Data":"e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6"}
Sep 17 14:07:26.440306 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.440293    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6a6870494e9bb53ddbfbef955ae9d85c2e33f192caeea4b052e7f0bb1dcbaf6"
Sep 17 14:07:26.449085 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.449060    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:07:26.526303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526257    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526291    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526313    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr7ww\" (UniqueName: \"kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww\") pod \"3d8842ac-393d-4c08-9209-042c729d1f17\" (UID: \"3d8842ac-393d-4c08-9209-042c729d1f17\") "
Sep 17 14:07:26.526788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:07:26.526857 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:07:26.526857 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.526836    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config" (OuterVolumeSpecName: "console-config") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:07:26.528630 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.528595    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww" (OuterVolumeSpecName: "kube-api-access-nr7ww") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "kube-api-access-nr7ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:07:26.528765 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.528700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:07:26.528765 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.528722    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d8842ac-393d-4c08-9209-042c729d1f17" (UID: "3d8842ac-393d-4c08-9209-042c729d1f17"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:07:26.627065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627029    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-oauth-serving-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:26.627065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627056    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:26.627065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627065    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d8842ac-393d-4c08-9209-042c729d1f17-console-config\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:26.627065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627072    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr7ww\" (UniqueName: \"kubernetes.io/projected/3d8842ac-393d-4c08-9209-042c729d1f17-kube-api-access-nr7ww\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:26.627320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627083    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-oauth-config\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:26.627320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:26.627091    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8842ac-393d-4c08-9209-042c729d1f17-console-serving-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:07:27.443918 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:27.443881    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687d69548d-4bfmz"
Sep 17 14:07:27.463135 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:27.463097    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:07:27.469936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:27.469903    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687d69548d-4bfmz"]
Sep 17 14:07:28.791176 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:28.791138    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8842ac-393d-4c08-9209-042c729d1f17" path="/var/lib/kubelet/pods/3d8842ac-393d-4c08-9209-042c729d1f17/volumes"
Sep 17 14:07:52.620256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.620218    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:07:52.620684 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.620457    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8842ac-393d-4c08-9209-042c729d1f17" containerName="console"
Sep 17 14:07:52.620684 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.620468    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8842ac-393d-4c08-9209-042c729d1f17" containerName="console"
Sep 17 14:07:52.620684 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.620517    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8842ac-393d-4c08-9209-042c729d1f17" containerName="console"
Sep 17 14:07:52.623942 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.623922    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.631025 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.631000    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 14:07:52.631667 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.631644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 14:07:52.631769 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.631649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 14:07:52.632029 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.632011    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 14:07:52.632148 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.632131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nwvjf\""
Sep 17 14:07:52.632258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.632245    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 14:07:52.632727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.632714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 14:07:52.634151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.634132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 14:07:52.639201 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.639182    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 14:07:52.648573 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.648529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:07:52.703602 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703602 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703822 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703822 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703822 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703822 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.703822 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.703820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trl8p\" (UniqueName: \"kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804575 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804575 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trl8p\" (UniqueName: \"kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.804815 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.804751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.805474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.805451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.805474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.805463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.805644 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.805495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.805795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.805769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.807341 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.807320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.807389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.807368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.816950 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.816923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trl8p\" (UniqueName: \"kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p\") pod \"console-86f8796574-jx566\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") " pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:52.932956 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:52.932918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:07:53.232267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:53.232177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:07:53.236829 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:07:53.236793    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4fa9d0_65e7_4fe8_8880_8960fd680dd8.slice/crio-ffa51f5c89dc171ec8c4a1213847b5f79fd6f507d6b75680ad2ad86e22c2dfa8 WatchSource:0}: Error finding container ffa51f5c89dc171ec8c4a1213847b5f79fd6f507d6b75680ad2ad86e22c2dfa8: Status 404 returned error can't find the container with id ffa51f5c89dc171ec8c4a1213847b5f79fd6f507d6b75680ad2ad86e22c2dfa8
Sep 17 14:07:53.544289 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:53.544202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8796574-jx566" event={"ID":"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8","Type":"ContainerStarted","Data":"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"}
Sep 17 14:07:53.544289 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:07:53.544264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8796574-jx566" event={"ID":"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8","Type":"ContainerStarted","Data":"ffa51f5c89dc171ec8c4a1213847b5f79fd6f507d6b75680ad2ad86e22c2dfa8"}
Sep 17 14:08:02.933446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:08:02.933339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:08:02.933446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:08:02.933417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:08:02.938181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:08:02.938155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:08:02.969306 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:08:02.969250    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f8796574-jx566" podStartSLOduration=10.969235535 podStartE2EDuration="10.969235535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:53.579032021 +0000 UTC m=+169.287904836" watchObservedRunningTime="2026-09-17 14:08:02.969235535 +0000 UTC m=+178.678108351"
Sep 17 14:08:03.584294 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:08:03.584263    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:09:19.813286 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:19.813236    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:09:44.832500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:44.832458    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86f8796574-jx566" podUID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" containerName="console" containerID="cri-o://23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac" gracePeriod=15
Sep 17 14:09:45.072160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.072130    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:09:45.109148 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109065    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109148 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109148 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109150    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109194    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109218    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109242    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109279    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trl8p\" (UniqueName: \"kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p\") pod \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\" (UID: \"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8\") "
Sep 17 14:09:45.109682 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config" (OuterVolumeSpecName: "console-config") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:45.109796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:45.109796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:45.109796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.109744    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:45.111416 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.111388    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:09:45.111506 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.111474    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:09:45.111506 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.111498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p" (OuterVolumeSpecName: "kube-api-access-trl8p") pod "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" (UID: "cd4fa9d0-65e7-4fe8-8880-8960fd680dd8"). InnerVolumeSpecName "kube-api-access-trl8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:09:45.210542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210504    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trl8p\" (UniqueName: \"kubernetes.io/projected/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-kube-api-access-trl8p\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210539    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-config\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210566    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-oauth-config\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210575    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-console-serving-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210584    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-oauth-serving-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210592    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.210782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.210600    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8-trusted-ca-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:09:45.929303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.929267    2560 generic.go:356] "Generic (PLEG): container finished" podID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" containerID="23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac" exitCode=0
Sep 17 14:09:45.929785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.929311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8796574-jx566" event={"ID":"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8","Type":"ContainerDied","Data":"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"}
Sep 17 14:09:45.929785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.929315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8796574-jx566"
Sep 17 14:09:45.929785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.929355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8796574-jx566" event={"ID":"cd4fa9d0-65e7-4fe8-8880-8960fd680dd8","Type":"ContainerDied","Data":"ffa51f5c89dc171ec8c4a1213847b5f79fd6f507d6b75680ad2ad86e22c2dfa8"}
Sep 17 14:09:45.929785 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.929377    2560 scope.go:117] "RemoveContainer" containerID="23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"
Sep 17 14:09:45.938726 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.938706    2560 scope.go:117] "RemoveContainer" containerID="23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"
Sep 17 14:09:45.939089 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:09:45.939069    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac\": container with ID starting with 23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac not found: ID does not exist" containerID="23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"
Sep 17 14:09:45.939143 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.939099    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac"} err="failed to get container status \"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac\": rpc error: code = NotFound desc = could not find container \"23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac\": container with ID starting with 23e2ea84071fb7cc200604e736c4814a2e563cf3efb399af624449e8cbc548ac not found: ID does not exist"
Sep 17 14:09:45.956252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.956216    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:09:45.960188 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:45.960161    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f8796574-jx566"]
Sep 17 14:09:46.786686 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:09:46.786647    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" path="/var/lib/kubelet/pods/cd4fa9d0-65e7-4fe8-8880-8960fd680dd8/volumes"
Sep 17 14:10:04.657044 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:04.657003    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 14:10:45.640735 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.640693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"]
Sep 17 14:10:45.641282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.641041    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" containerName="console"
Sep 17 14:10:45.641282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.641059    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" containerName="console"
Sep 17 14:10:45.641282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.641125    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4fa9d0-65e7-4fe8-8880-8960fd680dd8" containerName="console"
Sep 17 14:10:45.644125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.644095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.648058 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.648032    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:10:45.648207 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.648033    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:10:45.649058 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.649039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4q6fz\""
Sep 17 14:10:45.663072 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.663038    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"]
Sep 17 14:10:45.764715 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.764672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.764913 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.764737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlcp6\" (UniqueName: \"kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.764913 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.764795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.865146 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.865103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlcp6\" (UniqueName: \"kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.865350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.865164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.865350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.865213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.865532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.865510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.865628 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.865587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.875973 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.875932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlcp6\" (UniqueName: \"kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:45.953605 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:45.953572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:10:46.244447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:46.244418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"]
Sep 17 14:10:46.247021 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:10:46.246992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92843190_6f30_4cab_9f3f_533242e74a81.slice/crio-539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e WatchSource:0}: Error finding container 539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e: Status 404 returned error can't find the container with id 539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e
Sep 17 14:10:46.249052 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:46.249031    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:10:47.145744 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:47.145704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r" event={"ID":"92843190-6f30-4cab-9f3f-533242e74a81","Type":"ContainerStarted","Data":"539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e"}
Sep 17 14:10:53.173586 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:53.173524    2560 generic.go:356] "Generic (PLEG): container finished" podID="92843190-6f30-4cab-9f3f-533242e74a81" containerID="a9afc28a68d97eab8c3c447eda7777db63d6d19413ab6b97e94c022137baf97a" exitCode=0
Sep 17 14:10:53.173973 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:53.173590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r" event={"ID":"92843190-6f30-4cab-9f3f-533242e74a81","Type":"ContainerDied","Data":"a9afc28a68d97eab8c3c447eda7777db63d6d19413ab6b97e94c022137baf97a"}
Sep 17 14:10:56.188615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:56.188576    2560 generic.go:356] "Generic (PLEG): container finished" podID="92843190-6f30-4cab-9f3f-533242e74a81" containerID="4aa517f937a79a4bc8c71ecf335911e27d256067ddd7bb5c1b9783919a032cb4" exitCode=0
Sep 17 14:10:56.189002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:10:56.188644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r" event={"ID":"92843190-6f30-4cab-9f3f-533242e74a81","Type":"ContainerDied","Data":"4aa517f937a79a4bc8c71ecf335911e27d256067ddd7bb5c1b9783919a032cb4"}
Sep 17 14:11:05.226281 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:05.226239    2560 generic.go:356] "Generic (PLEG): container finished" podID="92843190-6f30-4cab-9f3f-533242e74a81" containerID="3196638dd716f9bede20e2cdf3f6d8c361bb3897c5f97b6408bfa5c792048346" exitCode=0
Sep 17 14:11:05.226763 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:05.226320    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r" event={"ID":"92843190-6f30-4cab-9f3f-533242e74a81","Type":"ContainerDied","Data":"3196638dd716f9bede20e2cdf3f6d8c361bb3897c5f97b6408bfa5c792048346"}
Sep 17 14:11:06.350067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.350039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:11:06.424900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.424858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util\") pod \"92843190-6f30-4cab-9f3f-533242e74a81\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") "
Sep 17 14:11:06.424900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.424910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlcp6\" (UniqueName: \"kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6\") pod \"92843190-6f30-4cab-9f3f-533242e74a81\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") "
Sep 17 14:11:06.425154 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.424932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle\") pod \"92843190-6f30-4cab-9f3f-533242e74a81\" (UID: \"92843190-6f30-4cab-9f3f-533242e74a81\") "
Sep 17 14:11:06.425712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.425685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle" (OuterVolumeSpecName: "bundle") pod "92843190-6f30-4cab-9f3f-533242e74a81" (UID: "92843190-6f30-4cab-9f3f-533242e74a81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:06.427197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.427170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6" (OuterVolumeSpecName: "kube-api-access-tlcp6") pod "92843190-6f30-4cab-9f3f-533242e74a81" (UID: "92843190-6f30-4cab-9f3f-533242e74a81"). InnerVolumeSpecName "kube-api-access-tlcp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:11:06.429318 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.429287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util" (OuterVolumeSpecName: "util") pod "92843190-6f30-4cab-9f3f-533242e74a81" (UID: "92843190-6f30-4cab-9f3f-533242e74a81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:06.526125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.526024    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:06.526125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.526062    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92843190-6f30-4cab-9f3f-533242e74a81-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:06.526125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:06.526072    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlcp6\" (UniqueName: \"kubernetes.io/projected/92843190-6f30-4cab-9f3f-533242e74a81-kube-api-access-tlcp6\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:07.238739 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:07.238709    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r"
Sep 17 14:11:07.238912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:07.238704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lhq5r" event={"ID":"92843190-6f30-4cab-9f3f-533242e74a81","Type":"ContainerDied","Data":"539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e"}
Sep 17 14:11:07.238912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:07.238830    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539fc648afbdf9dee808c8bb749fccd2b1770f2fdfea45e283fcc995993e530e"
Sep 17 14:11:13.937351 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937307    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"]
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="util"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937575    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="util"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937584    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="extract"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937590    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="extract"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937609    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="pull"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937615    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="pull"
Sep 17 14:11:13.937886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.937668    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="92843190-6f30-4cab-9f3f-533242e74a81" containerName="extract"
Sep 17 14:11:13.939723 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.939703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:13.942307 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.942279    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:11:13.942468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.942329    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 14:11:13.942468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.942459    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kmwnj\""
Sep 17 14:11:13.955189 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.955156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"]
Sep 17 14:11:13.981243 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.981199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db3c0dbf-9340-4862-bd77-66ec7dfcea99-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:13.981429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:13.981266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n8n8\" (UniqueName: \"kubernetes.io/projected/db3c0dbf-9340-4862-bd77-66ec7dfcea99-kube-api-access-8n8n8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.082593 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.082522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db3c0dbf-9340-4862-bd77-66ec7dfcea99-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.082593 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.082596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8n8\" (UniqueName: \"kubernetes.io/projected/db3c0dbf-9340-4862-bd77-66ec7dfcea99-kube-api-access-8n8n8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.082994 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.082970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db3c0dbf-9340-4862-bd77-66ec7dfcea99-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.098021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.097986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n8n8\" (UniqueName: \"kubernetes.io/projected/db3c0dbf-9340-4862-bd77-66ec7dfcea99-kube-api-access-8n8n8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xmcdb\" (UID: \"db3c0dbf-9340-4862-bd77-66ec7dfcea99\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.249020 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.248910    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"
Sep 17 14:11:14.536150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:14.535923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb"]
Sep 17 14:11:14.539254 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:11:14.539216    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3c0dbf_9340_4862_bd77_66ec7dfcea99.slice/crio-6d86e408ac634d86a92073e32fdcbfbd5b7a7fe67019ad2dfe0225a5c592e4d0 WatchSource:0}: Error finding container 6d86e408ac634d86a92073e32fdcbfbd5b7a7fe67019ad2dfe0225a5c592e4d0: Status 404 returned error can't find the container with id 6d86e408ac634d86a92073e32fdcbfbd5b7a7fe67019ad2dfe0225a5c592e4d0
Sep 17 14:11:15.269338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:15.269297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb" event={"ID":"db3c0dbf-9340-4862-bd77-66ec7dfcea99","Type":"ContainerStarted","Data":"6d86e408ac634d86a92073e32fdcbfbd5b7a7fe67019ad2dfe0225a5c592e4d0"}
Sep 17 14:11:17.279396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:17.279349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb" event={"ID":"db3c0dbf-9340-4862-bd77-66ec7dfcea99","Type":"ContainerStarted","Data":"79975522be035ca8fa6b7ecf398c6e4579c3493539f4a71ff70082204526ef67"}
Sep 17 14:11:17.304041 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:17.303979    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xmcdb" podStartSLOduration=2.156831239 podStartE2EDuration="4.303962235s" totalImagesPullingTime="2.147130996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:17.3021063 +0000 UTC m=+373.010979144" watchObservedRunningTime="2026-09-17 14:11:17.303962235 +0000 UTC m=+373.012835051"
Sep 17 14:11:18.320567 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.320518    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"]
Sep 17 14:11:18.322852 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.322832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.325363 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.325337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:11:18.325519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.325395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:11:18.325519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.325399    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4q6fz\""
Sep 17 14:11:18.336051 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.336024    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"]
Sep 17 14:11:18.418827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.418787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.418992 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.418850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqk2\" (UniqueName: \"kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.419051 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.419000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.520147 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.520104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.520147 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.520155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqk2\" (UniqueName: \"kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.520353 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.520180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.520515 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.520500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.520618 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.520597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.528881 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.528843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqk2\" (UniqueName: \"kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.632358 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.632260    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:18.912644 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:18.912539    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"]
Sep 17 14:11:18.915571 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:11:18.915522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec60831c_de02_400c_a86f_09fb83c175c4.slice/crio-f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6 WatchSource:0}: Error finding container f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6: Status 404 returned error can't find the container with id f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6
Sep 17 14:11:19.289628 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:19.289592    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec60831c-de02-400c-a86f-09fb83c175c4" containerID="38c5670c35d78c686ec5806f7cb7b267528c6d40167590dd2175af9f19e83fc8" exitCode=0
Sep 17 14:11:19.289851 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:19.289680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9" event={"ID":"ec60831c-de02-400c-a86f-09fb83c175c4","Type":"ContainerDied","Data":"38c5670c35d78c686ec5806f7cb7b267528c6d40167590dd2175af9f19e83fc8"}
Sep 17 14:11:19.289851 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:19.289738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9" event={"ID":"ec60831c-de02-400c-a86f-09fb83c175c4","Type":"ContainerStarted","Data":"f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6"}
Sep 17 14:11:25.411453 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.411408    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"]
Sep 17 14:11:25.443123 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.443083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"]
Sep 17 14:11:25.443302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.443212    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.449068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.449040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 14:11:25.449582 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.449537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hrtpl\""
Sep 17 14:11:25.450311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.450295    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 14:11:25.575063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.575020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8kj\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-kube-api-access-5w8kj\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.575063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.575068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.675502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.675400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8kj\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-kube-api-access-5w8kj\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.675502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.675463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.684498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.684456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.684712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.684500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8kj\" (UniqueName: \"kubernetes.io/projected/a7d9b80b-0159-403f-b3b5-76af38e08a10-kube-api-access-5w8kj\") pod \"cert-manager-cainjector-559cdd8c87-v4q4p\" (UID: \"a7d9b80b-0159-403f-b3b5-76af38e08a10\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:25.754907 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:25.754861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"
Sep 17 14:11:26.053961 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:26.053834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p"]
Sep 17 14:11:26.056732 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:11:26.056698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7d9b80b_0159_403f_b3b5_76af38e08a10.slice/crio-52fb83e1fa547c2d7d4909dbfcb844b1c8abbdbe06b673a4061459c2b3f6a71b WatchSource:0}: Error finding container 52fb83e1fa547c2d7d4909dbfcb844b1c8abbdbe06b673a4061459c2b3f6a71b: Status 404 returned error can't find the container with id 52fb83e1fa547c2d7d4909dbfcb844b1c8abbdbe06b673a4061459c2b3f6a71b
Sep 17 14:11:26.318303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:26.318205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p" event={"ID":"a7d9b80b-0159-403f-b3b5-76af38e08a10","Type":"ContainerStarted","Data":"52fb83e1fa547c2d7d4909dbfcb844b1c8abbdbe06b673a4061459c2b3f6a71b"}
Sep 17 14:11:29.334345 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:29.334301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p" event={"ID":"a7d9b80b-0159-403f-b3b5-76af38e08a10","Type":"ContainerStarted","Data":"2e3a6d8e107a0e990242d5720e740c468f1c7e46caf5b3b965de3584dd7d696d"}
Sep 17 14:11:29.356227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:29.356166    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-v4q4p" podStartSLOduration=1.85272547 podStartE2EDuration="4.35614487s" totalImagesPullingTime="2.5034194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:29.354799052 +0000 UTC m=+385.063671868" watchObservedRunningTime="2026-09-17 14:11:29.35614487 +0000 UTC m=+385.065017687"
Sep 17 14:11:30.341766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:30.341665    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec60831c-de02-400c-a86f-09fb83c175c4" containerID="cf17a812cfd4b510ad75939105000be09e1233e7eb16ec7fb03adc717adfd5d1" exitCode=0
Sep 17 14:11:30.341766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:30.341743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9" event={"ID":"ec60831c-de02-400c-a86f-09fb83c175c4","Type":"ContainerDied","Data":"cf17a812cfd4b510ad75939105000be09e1233e7eb16ec7fb03adc717adfd5d1"}
Sep 17 14:11:31.348857 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:31.348819    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec60831c-de02-400c-a86f-09fb83c175c4" containerID="6963c410a781a878bbbfdb62040c0f5f7cfd51cbec1b0957af536b1dcd19acf1" exitCode=0
Sep 17 14:11:31.349288 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:31.348884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9" event={"ID":"ec60831c-de02-400c-a86f-09fb83c175c4","Type":"ContainerDied","Data":"6963c410a781a878bbbfdb62040c0f5f7cfd51cbec1b0957af536b1dcd19acf1"}
Sep 17 14:11:32.475345 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.475315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:32.632440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.632333    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle\") pod \"ec60831c-de02-400c-a86f-09fb83c175c4\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") "
Sep 17 14:11:32.632440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.632398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdqk2\" (UniqueName: \"kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2\") pod \"ec60831c-de02-400c-a86f-09fb83c175c4\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") "
Sep 17 14:11:32.632440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.632449    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util\") pod \"ec60831c-de02-400c-a86f-09fb83c175c4\" (UID: \"ec60831c-de02-400c-a86f-09fb83c175c4\") "
Sep 17 14:11:32.632818 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.632794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle" (OuterVolumeSpecName: "bundle") pod "ec60831c-de02-400c-a86f-09fb83c175c4" (UID: "ec60831c-de02-400c-a86f-09fb83c175c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:32.634610 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.634579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2" (OuterVolumeSpecName: "kube-api-access-fdqk2") pod "ec60831c-de02-400c-a86f-09fb83c175c4" (UID: "ec60831c-de02-400c-a86f-09fb83c175c4"). InnerVolumeSpecName "kube-api-access-fdqk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:11:32.636819 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.636796    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util" (OuterVolumeSpecName: "util") pod "ec60831c-de02-400c-a86f-09fb83c175c4" (UID: "ec60831c-de02-400c-a86f-09fb83c175c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:32.733098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.733058    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:32.733098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.733091    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdqk2\" (UniqueName: \"kubernetes.io/projected/ec60831c-de02-400c-a86f-09fb83c175c4-kube-api-access-fdqk2\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:32.733098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:32.733104    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60831c-de02-400c-a86f-09fb83c175c4-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:33.359227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:33.359191    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9"
Sep 17 14:11:33.359227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:33.359208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx2fg9" event={"ID":"ec60831c-de02-400c-a86f-09fb83c175c4","Type":"ContainerDied","Data":"f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6"}
Sep 17 14:11:33.359449 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:33.359254    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f854c7867b8728a73e9706e588cdd779e3c48352b74bc6ba14ba1749b29169f6"
Sep 17 14:11:38.651459 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651415    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"]
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651678    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="extract"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651689    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="extract"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651698    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="util"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651704    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="util"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651722    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="pull"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651727    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="pull"
Sep 17 14:11:38.651886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.651763    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec60831c-de02-400c-a86f-09fb83c175c4" containerName="extract"
Sep 17 14:11:38.668995 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.668953    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"]
Sep 17 14:11:38.669169 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.669090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.671494 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.671467    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zc9ck\""
Sep 17 14:11:38.672679 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.672647    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 14:11:38.672821 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.672748    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:11:38.778170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.778116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da66e6c-1824-4743-90ec-5b3ca440cf1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.778170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.778178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h68q7\" (UniqueName: \"kubernetes.io/projected/8da66e6c-1824-4743-90ec-5b3ca440cf1d-kube-api-access-h68q7\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.879503 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.879455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da66e6c-1824-4743-90ec-5b3ca440cf1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.879503 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.879507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h68q7\" (UniqueName: \"kubernetes.io/projected/8da66e6c-1824-4743-90ec-5b3ca440cf1d-kube-api-access-h68q7\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.879891 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.879865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8da66e6c-1824-4743-90ec-5b3ca440cf1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.888874 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.888839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h68q7\" (UniqueName: \"kubernetes.io/projected/8da66e6c-1824-4743-90ec-5b3ca440cf1d-kube-api-access-h68q7\") pod \"openshift-lws-operator-fd8ccff4c-kxgfk\" (UID: \"8da66e6c-1824-4743-90ec-5b3ca440cf1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:38.980239 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:38.980194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"
Sep 17 14:11:39.275758 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:39.275598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk"]
Sep 17 14:11:39.278559 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:11:39.278516    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8da66e6c_1824_4743_90ec_5b3ca440cf1d.slice/crio-cf9538193f96f8ab7a66b01ae6b3e26fa215a1e5c7361750f5a21e9d9c950989 WatchSource:0}: Error finding container cf9538193f96f8ab7a66b01ae6b3e26fa215a1e5c7361750f5a21e9d9c950989: Status 404 returned error can't find the container with id cf9538193f96f8ab7a66b01ae6b3e26fa215a1e5c7361750f5a21e9d9c950989
Sep 17 14:11:39.385631 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:39.385597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk" event={"ID":"8da66e6c-1824-4743-90ec-5b3ca440cf1d","Type":"ContainerStarted","Data":"cf9538193f96f8ab7a66b01ae6b3e26fa215a1e5c7361750f5a21e9d9c950989"}
Sep 17 14:11:41.399048 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:41.398952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk" event={"ID":"8da66e6c-1824-4743-90ec-5b3ca440cf1d","Type":"ContainerStarted","Data":"a7591e301c08e22835560bec5cc8b6ee1b53d920ce0702c77e1b1503e73c7c8e"}
Sep 17 14:11:41.419098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:41.419032    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kxgfk" podStartSLOduration=1.576062865 podStartE2EDuration="3.419009152s" totalImagesPullingTime="1.842946287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:11:41.418003679 +0000 UTC m=+397.126876508" watchObservedRunningTime="2026-09-17 14:11:41.419009152 +0000 UTC m=+397.127881971"
Sep 17 14:11:44.247022 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.246983    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"]
Sep 17 14:11:44.249487 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.249461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.251804 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.251777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4q6fz\""
Sep 17 14:11:44.252161 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.252142    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:11:44.252523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.252500    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:11:44.261225 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.261194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"]
Sep 17 14:11:44.322064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.322011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.322064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.322067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfhk\" (UniqueName: \"kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.322302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.322138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.422854 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.422813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.423037 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.422866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfhk\" (UniqueName: \"kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.423037 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.422924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.423301 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.423278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.423335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.423316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.432871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.432838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfhk\" (UniqueName: \"kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.558613 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.558494    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:44.836136 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:44.836046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"]
Sep 17 14:11:44.840081 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:11:44.840051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277533c3_7557_47b1_b3b2_94664007dec6.slice/crio-fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644 WatchSource:0}: Error finding container fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644: Status 404 returned error can't find the container with id fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644
Sep 17 14:11:45.416919 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:45.416882    2560 generic.go:356] "Generic (PLEG): container finished" podID="277533c3-7557-47b1-b3b2-94664007dec6" containerID="a43c2eafaa9b002d7b5fde54096466a6e76effb3b423dc9332962571008f67f9" exitCode=0
Sep 17 14:11:45.417322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:45.416968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc" event={"ID":"277533c3-7557-47b1-b3b2-94664007dec6","Type":"ContainerDied","Data":"a43c2eafaa9b002d7b5fde54096466a6e76effb3b423dc9332962571008f67f9"}
Sep 17 14:11:45.417322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:45.417022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc" event={"ID":"277533c3-7557-47b1-b3b2-94664007dec6","Type":"ContainerStarted","Data":"fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644"}
Sep 17 14:11:46.423748 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:46.423650    2560 generic.go:356] "Generic (PLEG): container finished" podID="277533c3-7557-47b1-b3b2-94664007dec6" containerID="1ddf8cc6bddbb2fa712171b1bedf0658d788efff3f0694c97a3e033578d69fc8" exitCode=0
Sep 17 14:11:46.423748 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:46.423737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc" event={"ID":"277533c3-7557-47b1-b3b2-94664007dec6","Type":"ContainerDied","Data":"1ddf8cc6bddbb2fa712171b1bedf0658d788efff3f0694c97a3e033578d69fc8"}
Sep 17 14:11:47.430558 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:47.430508    2560 generic.go:356] "Generic (PLEG): container finished" podID="277533c3-7557-47b1-b3b2-94664007dec6" containerID="71ad56a7a87e89c90ba98dae0eb3e2317ab742367c66df4b764f4950e5370894" exitCode=0
Sep 17 14:11:47.430951 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:47.430595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc" event={"ID":"277533c3-7557-47b1-b3b2-94664007dec6","Type":"ContainerDied","Data":"71ad56a7a87e89c90ba98dae0eb3e2317ab742367c66df4b764f4950e5370894"}
Sep 17 14:11:48.559486 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.559458    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:48.655320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.655271    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util\") pod \"277533c3-7557-47b1-b3b2-94664007dec6\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") "
Sep 17 14:11:48.655519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.655345    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knfhk\" (UniqueName: \"kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk\") pod \"277533c3-7557-47b1-b3b2-94664007dec6\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") "
Sep 17 14:11:48.655519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.655402    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle\") pod \"277533c3-7557-47b1-b3b2-94664007dec6\" (UID: \"277533c3-7557-47b1-b3b2-94664007dec6\") "
Sep 17 14:11:48.656277 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.656247    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle" (OuterVolumeSpecName: "bundle") pod "277533c3-7557-47b1-b3b2-94664007dec6" (UID: "277533c3-7557-47b1-b3b2-94664007dec6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:48.657445 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.657422    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk" (OuterVolumeSpecName: "kube-api-access-knfhk") pod "277533c3-7557-47b1-b3b2-94664007dec6" (UID: "277533c3-7557-47b1-b3b2-94664007dec6"). InnerVolumeSpecName "kube-api-access-knfhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:11:48.663489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.663459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util" (OuterVolumeSpecName: "util") pod "277533c3-7557-47b1-b3b2-94664007dec6" (UID: "277533c3-7557-47b1-b3b2-94664007dec6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:11:48.756634 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.756470    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:48.756634 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.756513    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knfhk\" (UniqueName: \"kubernetes.io/projected/277533c3-7557-47b1-b3b2-94664007dec6-kube-api-access-knfhk\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:48.756634 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:48.756527    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277533c3-7557-47b1-b3b2-94664007dec6-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:11:49.441252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:49.441221    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc"
Sep 17 14:11:49.441436 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:49.441220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkmrtc" event={"ID":"277533c3-7557-47b1-b3b2-94664007dec6","Type":"ContainerDied","Data":"fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644"}
Sep 17 14:11:49.441436 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:11:49.441343    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa981a30b88023c3be88ff8d7aa6876afbce08f8bb5a841d8f261065c8078644"
Sep 17 14:12:00.739948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.739905    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"]
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740204    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="pull"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740215    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="pull"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740222    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="extract"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740227    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="extract"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740234    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="util"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740240    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="util"
Sep 17 14:12:00.740330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.740297    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="277533c3-7557-47b1-b3b2-94664007dec6" containerName="extract"
Sep 17 14:12:00.742532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.742511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.746188 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.746131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:12:00.746318 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.746283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4q6fz\""
Sep 17 14:12:00.747227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.747209    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:12:00.759035 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.759000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"]
Sep 17 14:12:00.854821 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.854786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfm7\" (UniqueName: \"kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.855005 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.854839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.855005 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.854858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.955829 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.955765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfm7\" (UniqueName: \"kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.955829 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.955829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.956037 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.955939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.956224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.956204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.956265 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.956213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:00.964761 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:00.964734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfm7\" (UniqueName: \"kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:01.052846 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:01.052752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:01.335840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:01.335809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"]
Sep 17 14:12:01.338408 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:01.338376    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9049d4_1f4b_4501_9546_f319f7fe9c30.slice/crio-79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc WatchSource:0}: Error finding container 79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc: Status 404 returned error can't find the container with id 79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc
Sep 17 14:12:01.494063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:01.494025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerStarted","Data":"f7b35f21c8edcf1094d4e0be8e8a4d22017988122aee795b391a55e1b6212211"}
Sep 17 14:12:01.494228 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:01.494082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerStarted","Data":"79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc"}
Sep 17 14:12:02.395931 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.395847    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"]
Sep 17 14:12:02.424365 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.424331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"]
Sep 17 14:12:02.424516 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.424450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.427085 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.427058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 14:12:02.427252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.427194    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-89xvx\""
Sep 17 14:12:02.427252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.427233    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 14:12:02.427702 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.427666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 14:12:02.429059 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.429041    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 14:12:02.467816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.467775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.467816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.467816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.468038 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.467836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfmm\" (UniqueName: \"kubernetes.io/projected/28bad35b-cf46-4f89-889a-0c0c48e3a00f-kube-api-access-lnfmm\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.468038 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.467865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-manifests\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.468038 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.467884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-tmp\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.500003 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.499964    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerID="f7b35f21c8edcf1094d4e0be8e8a4d22017988122aee795b391a55e1b6212211" exitCode=0
Sep 17 14:12:02.500172 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.500046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerDied","Data":"f7b35f21c8edcf1094d4e0be8e8a4d22017988122aee795b391a55e1b6212211"}
Sep 17 14:12:02.568741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.568699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.568741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.568743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.568980 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.568769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfmm\" (UniqueName: \"kubernetes.io/projected/28bad35b-cf46-4f89-889a-0c0c48e3a00f-kube-api-access-lnfmm\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.568980 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.568802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-manifests\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.568980 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.568834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-tmp\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.569342 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.569309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-manifests\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.571245 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.571219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28bad35b-cf46-4f89-889a-0c0c48e3a00f-tmp\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.571396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.571377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.571453 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.571436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28bad35b-cf46-4f89-889a-0c0c48e3a00f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.577907 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.577883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfmm\" (UniqueName: \"kubernetes.io/projected/28bad35b-cf46-4f89-889a-0c0c48e3a00f-kube-api-access-lnfmm\") pod \"opendatahub-operator-controller-manager-7895599765-lkfhd\" (UID: \"28bad35b-cf46-4f89-889a-0c0c48e3a00f\") " pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:02.735792 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:02.735749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:03.020100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:03.020069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"]
Sep 17 14:12:03.022005 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:03.021977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bad35b_cf46_4f89_889a_0c0c48e3a00f.slice/crio-1a313a71780b77c4623a5f8715e7980104b481c350ad9f7595156187ec382e6d WatchSource:0}: Error finding container 1a313a71780b77c4623a5f8715e7980104b481c350ad9f7595156187ec382e6d: Status 404 returned error can't find the container with id 1a313a71780b77c4623a5f8715e7980104b481c350ad9f7595156187ec382e6d
Sep 17 14:12:03.506810 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:03.506769    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerID="adf8da36b36206ce9258fad056b0bb7ff1a83ea2e8aa5236229ece2ff68a9edb" exitCode=0
Sep 17 14:12:03.507260 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:03.506826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerDied","Data":"adf8da36b36206ce9258fad056b0bb7ff1a83ea2e8aa5236229ece2ff68a9edb"}
Sep 17 14:12:03.508287 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:03.508264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd" event={"ID":"28bad35b-cf46-4f89-889a-0c0c48e3a00f","Type":"ContainerStarted","Data":"1a313a71780b77c4623a5f8715e7980104b481c350ad9f7595156187ec382e6d"}
Sep 17 14:12:04.517452 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:04.517357    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerID="aea74ad2a985128fdf6b0e94d512bc285b10fcb9b12a1af6c00d89ca1c1ffcaa" exitCode=0
Sep 17 14:12:04.517452 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:04.517404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerDied","Data":"aea74ad2a985128fdf6b0e94d512bc285b10fcb9b12a1af6c00d89ca1c1ffcaa"}
Sep 17 14:12:06.255165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.255133    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:06.299493 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.299463    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkfm7\" (UniqueName: \"kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7\") pod \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") "
Sep 17 14:12:06.299666 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.299506    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle\") pod \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") "
Sep 17 14:12:06.299666 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.299646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util\") pod \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\" (UID: \"2d9049d4-1f4b-4501-9546-f319f7fe9c30\") "
Sep 17 14:12:06.300284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.300248    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle" (OuterVolumeSpecName: "bundle") pod "2d9049d4-1f4b-4501-9546-f319f7fe9c30" (UID: "2d9049d4-1f4b-4501-9546-f319f7fe9c30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:12:06.301656 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.301629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7" (OuterVolumeSpecName: "kube-api-access-tkfm7") pod "2d9049d4-1f4b-4501-9546-f319f7fe9c30" (UID: "2d9049d4-1f4b-4501-9546-f319f7fe9c30"). InnerVolumeSpecName "kube-api-access-tkfm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:06.304757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.304725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util" (OuterVolumeSpecName: "util") pod "2d9049d4-1f4b-4501-9546-f319f7fe9c30" (UID: "2d9049d4-1f4b-4501-9546-f319f7fe9c30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:12:06.401011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.400970    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkfm7\" (UniqueName: \"kubernetes.io/projected/2d9049d4-1f4b-4501-9546-f319f7fe9c30-kube-api-access-tkfm7\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:06.401011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.401002    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:06.401011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.401011    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d9049d4-1f4b-4501-9546-f319f7fe9c30-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:06.528230 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.528137    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj"
Sep 17 14:12:06.528230 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.528135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0f9tcj" event={"ID":"2d9049d4-1f4b-4501-9546-f319f7fe9c30","Type":"ContainerDied","Data":"79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc"}
Sep 17 14:12:06.528454 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.528259    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c7a41d0970b8a3763ce79aeaa10064ff9f603abe9ff1cd8fab42c00d434bfc"
Sep 17 14:12:06.530097 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:06.530060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd" event={"ID":"28bad35b-cf46-4f89-889a-0c0c48e3a00f","Type":"ContainerStarted","Data":"55e1afc6900011fea644271b4d5ca309990c7ec3e408caf3809546ab38e17731"}
Sep 17 14:12:07.536149 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:07.536114    2560 generic.go:356] "Generic (PLEG): container finished" podID="28bad35b-cf46-4f89-889a-0c0c48e3a00f" containerID="55e1afc6900011fea644271b4d5ca309990c7ec3e408caf3809546ab38e17731" exitCode=0
Sep 17 14:12:07.536522 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:07.536160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd" event={"ID":"28bad35b-cf46-4f89-889a-0c0c48e3a00f","Type":"ContainerDied","Data":"55e1afc6900011fea644271b4d5ca309990c7ec3e408caf3809546ab38e17731"}
Sep 17 14:12:08.543597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:08.543534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd" event={"ID":"28bad35b-cf46-4f89-889a-0c0c48e3a00f","Type":"ContainerStarted","Data":"2761df21b3589e7e11e65a618bcb0a78ab1cf2bd0e6126fce98c36db7ebeff83"}
Sep 17 14:12:08.544061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:08.543705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:08.589568 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:08.589495    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd" podStartSLOduration=1.898507265 podStartE2EDuration="6.589474264s" totalImagesPullingTime="3.602627724s" totalInitContainerRuntime="1.088339275s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:08.582678841 +0000 UTC m=+424.291551656" watchObservedRunningTime="2026-09-17 14:12:08.589474264 +0000 UTC m=+424.298347080"
Sep 17 14:12:19.550165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:19.550128    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7895599765-lkfhd"
Sep 17 14:12:21.742469 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742433    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"]
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742769    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="util"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742783    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="util"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742790    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="extract"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742795    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="extract"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742803    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="pull"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742809    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="pull"
Sep 17 14:12:21.742898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.742852    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9049d4-1f4b-4501-9546-f319f7fe9c30" containerName="extract"
Sep 17 14:12:21.750989 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.750960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.754527 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.754056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 14:12:21.754527 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.754167    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 14:12:21.754527 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.754067    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 14:12:21.755115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.755094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bt6mz\""
Sep 17 14:12:21.755882 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.755863    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 14:12:21.763621 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.763590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"]
Sep 17 14:12:21.813203 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.813155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tmp\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.813402 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.813255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65w9l\" (UniqueName: \"kubernetes.io/projected/c4193e73-52de-4df8-8baf-99c3c31d7e0d-kube-api-access-65w9l\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.813402 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.813299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.914629 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.914591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65w9l\" (UniqueName: \"kubernetes.io/projected/c4193e73-52de-4df8-8baf-99c3c31d7e0d-kube-api-access-65w9l\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.914853 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.914642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.914853 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:12:21.914812    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 17 14:12:21.914967 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.914870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tmp\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.914967 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:12:21.914883    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs podName:c4193e73-52de-4df8-8baf-99c3c31d7e0d nodeName:}" failed. No retries permitted until 2026-09-17 14:12:22.414865853 +0000 UTC m=+438.123738647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs") pod "kube-auth-proxy-7c6769664b-zvgzb" (UID: "c4193e73-52de-4df8-8baf-99c3c31d7e0d") : secret "kube-auth-proxy-tls" not found
Sep 17 14:12:21.917330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.917291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tmp\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:21.931291 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:21.931259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65w9l\" (UniqueName: \"kubernetes.io/projected/c4193e73-52de-4df8-8baf-99c3c31d7e0d-kube-api-access-65w9l\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:22.419669 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:22.419624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:22.422276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:22.422243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4193e73-52de-4df8-8baf-99c3c31d7e0d-tls-certs\") pod \"kube-auth-proxy-7c6769664b-zvgzb\" (UID: \"c4193e73-52de-4df8-8baf-99c3c31d7e0d\") " pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:22.666009 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:22.665965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"
Sep 17 14:12:22.963239 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:22.963204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb"]
Sep 17 14:12:22.965809 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:22.965780    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4193e73_52de_4df8_8baf_99c3c31d7e0d.slice/crio-33769bd43c013ed26154f148d7584f32dc5046050e52a57a070963515f82eada WatchSource:0}: Error finding container 33769bd43c013ed26154f148d7584f32dc5046050e52a57a070963515f82eada: Status 404 returned error can't find the container with id 33769bd43c013ed26154f148d7584f32dc5046050e52a57a070963515f82eada
Sep 17 14:12:23.475224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.475134    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:23.478905 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.478868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.482114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.481829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 14:12:23.482114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.481914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 14:12:23.482114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.481948    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bhwjs\""
Sep 17 14:12:23.482114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.481829    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 14:12:23.482114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.482081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 14:12:23.499280 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.499240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:23.527643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527599    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.527840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.527840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.527840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f4rq\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.528024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.528024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.527949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.528024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.528009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.613615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.613570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb" event={"ID":"c4193e73-52de-4df8-8baf-99c3c31d7e0d","Type":"ContainerStarted","Data":"33769bd43c013ed26154f148d7584f32dc5046050e52a57a070963515f82eada"}
Sep 17 14:12:23.629350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.629350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f4rq\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.629572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.630800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.630567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.633221 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.633143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.633221 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.633215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.633595 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.633574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.634035 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.634002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.647173 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.647101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f4rq\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.647938 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.647909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2vqq\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:23.793270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:23.793150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:24.094210 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:24.094115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:25.420444 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:25.420392    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c8cb5a_5d56_443b_8a97_02fb047ab977.slice/crio-3f001d46a8d8b396390ea0b15ced2e37cdd252e166a24514323df6e38761f853 WatchSource:0}: Error finding container 3f001d46a8d8b396390ea0b15ced2e37cdd252e166a24514323df6e38761f853: Status 404 returned error can't find the container with id 3f001d46a8d8b396390ea0b15ced2e37cdd252e166a24514323df6e38761f853
Sep 17 14:12:25.625467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:25.625426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb" event={"ID":"c4193e73-52de-4df8-8baf-99c3c31d7e0d","Type":"ContainerStarted","Data":"e8d55303b1ec031fa310891a9d09d937a618ba9c1378d652b06a5449acb17344"}
Sep 17 14:12:25.626793 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:25.626761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" event={"ID":"19c8cb5a-5d56-443b-8a97-02fb047ab977","Type":"ContainerStarted","Data":"3f001d46a8d8b396390ea0b15ced2e37cdd252e166a24514323df6e38761f853"}
Sep 17 14:12:25.644926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:25.644871    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb" podStartSLOduration=2.132229944 podStartE2EDuration="4.644853488s" totalImagesPullingTime="2.512623544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:25.643782673 +0000 UTC m=+441.352655489" watchObservedRunningTime="2026-09-17 14:12:25.644853488 +0000 UTC m=+441.353726303"
Sep 17 14:12:28.853010 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:28.852969    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:12:28.853283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:28.853045    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:12:29.650133 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:29.650094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" event={"ID":"19c8cb5a-5d56-443b-8a97-02fb047ab977","Type":"ContainerStarted","Data":"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"}
Sep 17 14:12:29.650912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:29.650878    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:29.652608 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:29.652569    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-f2vqq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 14:12:29.652762 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:29.652645    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 14:12:29.675977 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:29.675916    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" podStartSLOduration=3.245428962 podStartE2EDuration="6.675895372s" totalImagesPullingTime="3.43046641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:29.673958478 +0000 UTC m=+445.382831311" watchObservedRunningTime="2026-09-17 14:12:29.675895372 +0000 UTC m=+445.384768187"
Sep 17 14:12:30.656968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:30.656924    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:39.671290 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.671247    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"]
Sep 17 14:12:39.736019 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.735974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"]
Sep 17 14:12:39.736204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.735987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d76bf-7d42-437c-8ce8-280c4e51d6fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872701 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.872701 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.872507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9tj\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-kube-api-access-6x9tj\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973608 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x9tj\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-kube-api-access-6x9tj\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d76bf-7d42-437c-8ce8-280c4e51d6fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.973796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.973776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.974532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.974490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.976213 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.976183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d76bf-7d42-437c-8ce8-280c4e51d6fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.976335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.976257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.976335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.976329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.976432 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.976409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.983398 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.983367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:39.983735 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:39.983710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x9tj\" (UniqueName: \"kubernetes.io/projected/241d76bf-7d42-437c-8ce8-280c4e51d6fa-kube-api-access-6x9tj\") pod \"istiod-openshift-gateway-5677ccb49b-s7nd9\" (UID: \"241d76bf-7d42-437c-8ce8-280c4e51d6fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:40.049004 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.048946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:40.371216 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.371183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"]
Sep 17 14:12:40.373928 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:40.373894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241d76bf_7d42_437c_8ce8_280c4e51d6fa.slice/crio-87f95763ee1d9abcad63622a3a1ec6baac9b9533d0268cac3249c67f07c72bd9 WatchSource:0}: Error finding container 87f95763ee1d9abcad63622a3a1ec6baac9b9533d0268cac3249c67f07c72bd9: Status 404 returned error can't find the container with id 87f95763ee1d9abcad63622a3a1ec6baac9b9533d0268cac3249c67f07c72bd9
Sep 17 14:12:40.376771 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.376734    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:12:40.376876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.376803    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:12:40.714620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.714579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9" event={"ID":"241d76bf-7d42-437c-8ce8-280c4e51d6fa","Type":"ContainerStarted","Data":"6ae48915d0ad5dcc0c04719edd9818354f3e397ccf2135e85fa263d805910549"}
Sep 17 14:12:40.715014 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.714635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9" event={"ID":"241d76bf-7d42-437c-8ce8-280c4e51d6fa","Type":"ContainerStarted","Data":"87f95763ee1d9abcad63622a3a1ec6baac9b9533d0268cac3249c67f07c72bd9"}
Sep 17 14:12:40.715014 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.714777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:40.758366 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:40.758292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9" podStartSLOduration=1.758264736 podStartE2EDuration="1.758264736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:40.756789332 +0000 UTC m=+456.465662148" watchObservedRunningTime="2026-09-17 14:12:40.758264736 +0000 UTC m=+456.467137553"
Sep 17 14:12:41.721289 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:41.721249    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9"
Sep 17 14:12:41.856421 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:41.856375    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:41.856838 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:41.856796    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerName="discovery" containerID="cri-o://e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152" gracePeriod=30
Sep 17 14:12:42.143729 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.143696    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:42.297219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297270    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297324    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f4rq\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts\") pod \"19c8cb5a-5d56-443b-8a97-02fb047ab977\" (UID: \"19c8cb5a-5d56-443b-8a97-02fb047ab977\") "
Sep 17 14:12:42.297831 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.297800    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:42.300030 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.299979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token" (OuterVolumeSpecName: "istio-token") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:42.300145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.300064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:12:42.300145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.299988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:12:42.300145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.300046    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs" (OuterVolumeSpecName: "local-certs") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:12:42.300145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.300122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts" (OuterVolumeSpecName: "cacerts") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:12:42.300272 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.300199    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq" (OuterVolumeSpecName: "kube-api-access-6f4rq") pod "19c8cb5a-5d56-443b-8a97-02fb047ab977" (UID: "19c8cb5a-5d56-443b-8a97-02fb047ab977"). InnerVolumeSpecName "kube-api-access-6f4rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:42.398933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398894    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c8cb5a-5d56-443b-8a97-02fb047ab977-local-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.398933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398927    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-dns-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.398933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398938    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f4rq\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-kube-api-access-6f4rq\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.399179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398949    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-cacerts\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.399179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398958    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-csr-ca-configmap\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.399179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398967    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.399179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.398975    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19c8cb5a-5d56-443b-8a97-02fb047ab977-istio-kubeconfig\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.594389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.594289    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"]
Sep 17 14:12:42.594677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.594659    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerName="discovery"
Sep 17 14:12:42.594776 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.594680    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerName="discovery"
Sep 17 14:12:42.594776 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.594762    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerName="discovery"
Sep 17 14:12:42.597330 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.597305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.600115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.600091    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g8tp2\""
Sep 17 14:12:42.600277 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.600249    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 17 14:12:42.621157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.621116    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"]
Sep 17 14:12:42.701566 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.701501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwdb5\" (UniqueName: \"kubernetes.io/projected/04a72438-efba-4be0-84f1-e88becdd2fd6-kube-api-access-fwdb5\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.701763 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.701625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a72438-efba-4be0-84f1-e88becdd2fd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.727466 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.727428    2560 generic.go:356] "Generic (PLEG): container finished" podID="19c8cb5a-5d56-443b-8a97-02fb047ab977" containerID="e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152" exitCode=0
Sep 17 14:12:42.727895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.727531    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"
Sep 17 14:12:42.727895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.727582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" event={"ID":"19c8cb5a-5d56-443b-8a97-02fb047ab977","Type":"ContainerDied","Data":"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"}
Sep 17 14:12:42.727895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.727647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq" event={"ID":"19c8cb5a-5d56-443b-8a97-02fb047ab977","Type":"ContainerDied","Data":"3f001d46a8d8b396390ea0b15ced2e37cdd252e166a24514323df6e38761f853"}
Sep 17 14:12:42.727895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.727678    2560 scope.go:117] "RemoveContainer" containerID="e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"
Sep 17 14:12:42.737783 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.737761    2560 scope.go:117] "RemoveContainer" containerID="e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"
Sep 17 14:12:42.738138 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:12:42.738117    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152\": container with ID starting with e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152 not found: ID does not exist" containerID="e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"
Sep 17 14:12:42.738200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.738147    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152"} err="failed to get container status \"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152\": rpc error: code = NotFound desc = could not find container \"e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152\": container with ID starting with e5f66d38a833af6eeb83e1141c7873d434c447146fbb8cf0cda4b42da1dc9152 not found: ID does not exist"
Sep 17 14:12:42.755458 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.755414    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:42.761321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.761285    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq"]
Sep 17 14:12:42.788840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.788799    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c8cb5a-5d56-443b-8a97-02fb047ab977" path="/var/lib/kubelet/pods/19c8cb5a-5d56-443b-8a97-02fb047ab977/volumes"
Sep 17 14:12:42.802863 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.802818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a72438-efba-4be0-84f1-e88becdd2fd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.803202 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.803132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwdb5\" (UniqueName: \"kubernetes.io/projected/04a72438-efba-4be0-84f1-e88becdd2fd6-kube-api-access-fwdb5\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.805421 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.805398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04a72438-efba-4be0-84f1-e88becdd2fd6-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.819744 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.819703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwdb5\" (UniqueName: \"kubernetes.io/projected/04a72438-efba-4be0-84f1-e88becdd2fd6-kube-api-access-fwdb5\") pod \"kserve-controller-manager-d6f4b65b8-v9gx4\" (UID: \"04a72438-efba-4be0-84f1-e88becdd2fd6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:42.908947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:42.908835    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:43.202021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:43.201989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"]
Sep 17 14:12:43.204734 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:12:43.204701    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a72438_efba_4be0_84f1_e88becdd2fd6.slice/crio-3442fbf2fb37f1be09daeeba7a196f7a1938d46df218858c5df2e1bbadad2ec5 WatchSource:0}: Error finding container 3442fbf2fb37f1be09daeeba7a196f7a1938d46df218858c5df2e1bbadad2ec5: Status 404 returned error can't find the container with id 3442fbf2fb37f1be09daeeba7a196f7a1938d46df218858c5df2e1bbadad2ec5
Sep 17 14:12:43.733912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:43.733872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4" event={"ID":"04a72438-efba-4be0-84f1-e88becdd2fd6","Type":"ContainerStarted","Data":"3442fbf2fb37f1be09daeeba7a196f7a1938d46df218858c5df2e1bbadad2ec5"}
Sep 17 14:12:46.751200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:46.751157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4" event={"ID":"04a72438-efba-4be0-84f1-e88becdd2fd6","Type":"ContainerStarted","Data":"ef82d51cce294881e83b8c77e3ada5593e534dd25f2b38de48b147e3ab6012fd"}
Sep 17 14:12:46.751674 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:46.751290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:12:46.774983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:12:46.774923    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4" podStartSLOduration=1.818649621 podStartE2EDuration="4.77490385s" totalImagesPullingTime="2.956254229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:46.773064493 +0000 UTC m=+462.481937310" watchObservedRunningTime="2026-09-17 14:12:46.77490385 +0000 UTC m=+462.483776666"
Sep 17 14:13:04.683437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:04.683401    2560 scope.go:117] "RemoveContainer" containerID="dd498c4df1dd5749b9befa199b7603cb7a276d3a046b3ba61f18855ff1bbb8d2"
Sep 17 14:13:17.761873 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:17.761836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9gx4"
Sep 17 14:13:38.781190 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.781148    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"]
Sep 17 14:13:38.784821 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.784793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.787398 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.787363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4q6fz\""
Sep 17 14:13:38.787398 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.787383    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:13:38.787646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.787363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:13:38.793696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.793668    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"]
Sep 17 14:13:38.851913 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.851879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.852105 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.851927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kskfh\" (UniqueName: \"kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.852105 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.851975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.875098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.875054    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"]
Sep 17 14:13:38.877635 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.877609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:38.887707 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.887678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"]
Sep 17 14:13:38.953056 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.953056 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t68ln\" (UniqueName: \"kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:38.953316 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kskfh\" (UniqueName: \"kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.953316 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.953316 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:38.953316 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:38.953533 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.953533 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.953525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.962193 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.962154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kskfh\" (UniqueName: \"kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:38.977836 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.977797    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"]
Sep 17 14:13:38.980486 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.980462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:38.989368 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:38.989341    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"]
Sep 17 14:13:39.054205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t68ln\" (UniqueName: \"kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.054205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.054205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.054467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054242    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.054467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.054467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfql\" (UniqueName: \"kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.054673 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.054673 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.054648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.063170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.063142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t68ln\" (UniqueName: \"kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.081528 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.081489    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"]
Sep 17 14:13:39.086998 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.086959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.095093 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.095056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"]
Sep 17 14:13:39.095277 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.095111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:39.155210 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfv5w\" (UniqueName: \"kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfql\" (UniqueName: \"kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.155864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.155804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.164701 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.164674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfql\" (UniqueName: \"kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.187502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.187467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:39.257113 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.256477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfv5w\" (UniqueName: \"kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.257113 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.256585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.257113 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.256622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.257113 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.257059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.257429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.257234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.265698 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.265659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfv5w\" (UniqueName: \"kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.290310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.290259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:39.373511 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.373461    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"]
Sep 17 14:13:39.376798 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:13:39.376768    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63096664_a2e1_456e_a404_ed31ba1cca44.slice/crio-e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78 WatchSource:0}: Error finding container e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78: Status 404 returned error can't find the container with id e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78
Sep 17 14:13:39.399460 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.399424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:39.472504 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.472464    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"]
Sep 17 14:13:39.475085 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:13:39.475041    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d8b455_d7f0_4fe0_8d3a_1f1f54fbaca3.slice/crio-8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663 WatchSource:0}: Error finding container 8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663: Status 404 returned error can't find the container with id 8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663
Sep 17 14:13:39.565423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.565395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"]
Sep 17 14:13:39.567394 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:13:39.567359    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4586b486_e4d3_4c8a_9366_798e0470f81a.slice/crio-e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53 WatchSource:0}: Error finding container e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53: Status 404 returned error can't find the container with id e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53
Sep 17 14:13:39.682955 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:39.682852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"]
Sep 17 14:13:39.718637 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:13:39.718588    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486ce910_9c25_4c41_b022_cad6539337be.slice/crio-fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e WatchSource:0}: Error finding container fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e: Status 404 returned error can't find the container with id fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e
Sep 17 14:13:40.002505 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.002471    2560 generic.go:356] "Generic (PLEG): container finished" podID="486ce910-9c25-4c41-b022-cad6539337be" containerID="abe30094d020bab6304686b0fdc111a0a7d8112eca392fef452cffa423e8c3ed" exitCode=0
Sep 17 14:13:40.002978 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.002559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm" event={"ID":"486ce910-9c25-4c41-b022-cad6539337be","Type":"ContainerDied","Data":"abe30094d020bab6304686b0fdc111a0a7d8112eca392fef452cffa423e8c3ed"}
Sep 17 14:13:40.002978 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.002604    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm" event={"ID":"486ce910-9c25-4c41-b022-cad6539337be","Type":"ContainerStarted","Data":"fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e"}
Sep 17 14:13:40.004188 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.004165    2560 generic.go:356] "Generic (PLEG): container finished" podID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerID="61574ff1fa3e0d255df3410eac67e8fe17c82f67d193c2bd8f0eac3fda1d1abd" exitCode=0
Sep 17 14:13:40.004311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.004261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944" event={"ID":"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3","Type":"ContainerDied","Data":"61574ff1fa3e0d255df3410eac67e8fe17c82f67d193c2bd8f0eac3fda1d1abd"}
Sep 17 14:13:40.004376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.004329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944" event={"ID":"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3","Type":"ContainerStarted","Data":"8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663"}
Sep 17 14:13:40.005845 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.005822    2560 generic.go:356] "Generic (PLEG): container finished" podID="63096664-a2e1-456e-a404-ed31ba1cca44" containerID="089c0fcda6758bb854291740fe66e4f1c12b05abda9099210e83491532ff08cc" exitCode=0
Sep 17 14:13:40.005904 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.005854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4" event={"ID":"63096664-a2e1-456e-a404-ed31ba1cca44","Type":"ContainerDied","Data":"089c0fcda6758bb854291740fe66e4f1c12b05abda9099210e83491532ff08cc"}
Sep 17 14:13:40.005951 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.005902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4" event={"ID":"63096664-a2e1-456e-a404-ed31ba1cca44","Type":"ContainerStarted","Data":"e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78"}
Sep 17 14:13:40.007817 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.007792    2560 generic.go:356] "Generic (PLEG): container finished" podID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerID="a49892fadddaace5421fa57d98fddd46006dd116646af0d8354c9d0612e2ff24" exitCode=0
Sep 17 14:13:40.007898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.007835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv" event={"ID":"4586b486-e4d3-4c8a-9366-798e0470f81a","Type":"ContainerDied","Data":"a49892fadddaace5421fa57d98fddd46006dd116646af0d8354c9d0612e2ff24"}
Sep 17 14:13:40.007942 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:40.007895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv" event={"ID":"4586b486-e4d3-4c8a-9366-798e0470f81a","Type":"ContainerStarted","Data":"e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53"}
Sep 17 14:13:42.018706 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.018673    2560 generic.go:356] "Generic (PLEG): container finished" podID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerID="dc56b412bd06eebca18628354ef21424b737dd9811efb24f07475fd5cf6e70bc" exitCode=0
Sep 17 14:13:42.019087 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.018750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv" event={"ID":"4586b486-e4d3-4c8a-9366-798e0470f81a","Type":"ContainerDied","Data":"dc56b412bd06eebca18628354ef21424b737dd9811efb24f07475fd5cf6e70bc"}
Sep 17 14:13:42.020909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.020884    2560 generic.go:356] "Generic (PLEG): container finished" podID="486ce910-9c25-4c41-b022-cad6539337be" containerID="7377ab9accf5df3ba608d696b4b3d0b6c4e930bb6318870b330b0b41619207b5" exitCode=0
Sep 17 14:13:42.021024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.020971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm" event={"ID":"486ce910-9c25-4c41-b022-cad6539337be","Type":"ContainerDied","Data":"7377ab9accf5df3ba608d696b4b3d0b6c4e930bb6318870b330b0b41619207b5"}
Sep 17 14:13:42.023222 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.023195    2560 generic.go:356] "Generic (PLEG): container finished" podID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerID="f935e14559a36c02018b1d677789843853616ee488e5c499d962a7eeed5508a1" exitCode=0
Sep 17 14:13:42.023319 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.023238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944" event={"ID":"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3","Type":"ContainerDied","Data":"f935e14559a36c02018b1d677789843853616ee488e5c499d962a7eeed5508a1"}
Sep 17 14:13:42.025381 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.025355    2560 generic.go:356] "Generic (PLEG): container finished" podID="63096664-a2e1-456e-a404-ed31ba1cca44" containerID="56d9fbf0d7d9ad709b02ec80941da06dadd3bc10b3451ea9bbed5cc55415ee30" exitCode=0
Sep 17 14:13:42.025480 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:42.025393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4" event={"ID":"63096664-a2e1-456e-a404-ed31ba1cca44","Type":"ContainerDied","Data":"56d9fbf0d7d9ad709b02ec80941da06dadd3bc10b3451ea9bbed5cc55415ee30"}
Sep 17 14:13:43.032530 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.032491    2560 generic.go:356] "Generic (PLEG): container finished" podID="63096664-a2e1-456e-a404-ed31ba1cca44" containerID="8de1683dc94539fd3a4b3329bcc475bf53e5aef35930381576033b8f87fbcf16" exitCode=0
Sep 17 14:13:43.032989 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.032577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4" event={"ID":"63096664-a2e1-456e-a404-ed31ba1cca44","Type":"ContainerDied","Data":"8de1683dc94539fd3a4b3329bcc475bf53e5aef35930381576033b8f87fbcf16"}
Sep 17 14:13:43.034919 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.034887    2560 generic.go:356] "Generic (PLEG): container finished" podID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerID="4e52fa531495d97f6541cd8babb3d1b4aff7fbf08d15874314aa5e76f4d12b6a" exitCode=0
Sep 17 14:13:43.035071 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.034962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv" event={"ID":"4586b486-e4d3-4c8a-9366-798e0470f81a","Type":"ContainerDied","Data":"4e52fa531495d97f6541cd8babb3d1b4aff7fbf08d15874314aa5e76f4d12b6a"}
Sep 17 14:13:43.037200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.037172    2560 generic.go:356] "Generic (PLEG): container finished" podID="486ce910-9c25-4c41-b022-cad6539337be" containerID="8f6174bb6afbb0a54558da463c980549fb3c5feb21a9783be7b55540b4afc3e6" exitCode=0
Sep 17 14:13:43.037321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.037252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm" event={"ID":"486ce910-9c25-4c41-b022-cad6539337be","Type":"ContainerDied","Data":"8f6174bb6afbb0a54558da463c980549fb3c5feb21a9783be7b55540b4afc3e6"}
Sep 17 14:13:43.039218 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.039194    2560 generic.go:356] "Generic (PLEG): container finished" podID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerID="ef67319faa7f8c9626d60e20e17f34da3e8ca2336572e6147b064aae365d8d15" exitCode=0
Sep 17 14:13:43.039342 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:43.039241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944" event={"ID":"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3","Type":"ContainerDied","Data":"ef67319faa7f8c9626d60e20e17f34da3e8ca2336572e6147b064aae365d8d15"}
Sep 17 14:13:44.184384 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.184356    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:44.219679 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.219646    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:44.251778 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.251748    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:44.259249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.259223    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:44.303498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303407    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t68ln\" (UniqueName: \"kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln\") pod \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") "
Sep 17 14:13:44.303498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle\") pod \"63096664-a2e1-456e-a404-ed31ba1cca44\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") "
Sep 17 14:13:44.303498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util\") pod \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") "
Sep 17 14:13:44.303824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303510    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util\") pod \"63096664-a2e1-456e-a404-ed31ba1cca44\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") "
Sep 17 14:13:44.303824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303578    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle\") pod \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\" (UID: \"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3\") "
Sep 17 14:13:44.303824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.303603    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kskfh\" (UniqueName: \"kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh\") pod \"63096664-a2e1-456e-a404-ed31ba1cca44\" (UID: \"63096664-a2e1-456e-a404-ed31ba1cca44\") "
Sep 17 14:13:44.304133 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.304092    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle" (OuterVolumeSpecName: "bundle") pod "63096664-a2e1-456e-a404-ed31ba1cca44" (UID: "63096664-a2e1-456e-a404-ed31ba1cca44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.304273 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.304151    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle" (OuterVolumeSpecName: "bundle") pod "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" (UID: "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.305936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.305907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln" (OuterVolumeSpecName: "kube-api-access-t68ln") pod "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" (UID: "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3"). InnerVolumeSpecName "kube-api-access-t68ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:44.306254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.306232    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh" (OuterVolumeSpecName: "kube-api-access-kskfh") pod "63096664-a2e1-456e-a404-ed31ba1cca44" (UID: "63096664-a2e1-456e-a404-ed31ba1cca44"). InnerVolumeSpecName "kube-api-access-kskfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:44.309020 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.308975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util" (OuterVolumeSpecName: "util") pod "63096664-a2e1-456e-a404-ed31ba1cca44" (UID: "63096664-a2e1-456e-a404-ed31ba1cca44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.309790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.309766    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util" (OuterVolumeSpecName: "util") pod "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" (UID: "07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.404718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404671    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwfql\" (UniqueName: \"kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql\") pod \"4586b486-e4d3-4c8a-9366-798e0470f81a\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") "
Sep 17 14:13:44.404718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util\") pod \"486ce910-9c25-4c41-b022-cad6539337be\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") "
Sep 17 14:13:44.404986 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle\") pod \"4586b486-e4d3-4c8a-9366-798e0470f81a\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") "
Sep 17 14:13:44.404986 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle\") pod \"486ce910-9c25-4c41-b022-cad6539337be\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") "
Sep 17 14:13:44.404986 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util\") pod \"4586b486-e4d3-4c8a-9366-798e0470f81a\" (UID: \"4586b486-e4d3-4c8a-9366-798e0470f81a\") "
Sep 17 14:13:44.404986 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.404856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfv5w\" (UniqueName: \"kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w\") pod \"486ce910-9c25-4c41-b022-cad6539337be\" (UID: \"486ce910-9c25-4c41-b022-cad6539337be\") "
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405038    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405060    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405073    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63096664-a2e1-456e-a404-ed31ba1cca44-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405086    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405098    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kskfh\" (UniqueName: \"kubernetes.io/projected/63096664-a2e1-456e-a404-ed31ba1cca44-kube-api-access-kskfh\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405184 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405111    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t68ln\" (UniqueName: \"kubernetes.io/projected/07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3-kube-api-access-t68ln\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.405442 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405303    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle" (OuterVolumeSpecName: "bundle") pod "486ce910-9c25-4c41-b022-cad6539337be" (UID: "486ce910-9c25-4c41-b022-cad6539337be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.405584 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.405532    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle" (OuterVolumeSpecName: "bundle") pod "4586b486-e4d3-4c8a-9366-798e0470f81a" (UID: "4586b486-e4d3-4c8a-9366-798e0470f81a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.407107 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.407082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w" (OuterVolumeSpecName: "kube-api-access-cfv5w") pod "486ce910-9c25-4c41-b022-cad6539337be" (UID: "486ce910-9c25-4c41-b022-cad6539337be"). InnerVolumeSpecName "kube-api-access-cfv5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:44.407296 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.407278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql" (OuterVolumeSpecName: "kube-api-access-qwfql") pod "4586b486-e4d3-4c8a-9366-798e0470f81a" (UID: "4586b486-e4d3-4c8a-9366-798e0470f81a"). InnerVolumeSpecName "kube-api-access-qwfql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:44.411177 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.411140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util" (OuterVolumeSpecName: "util") pod "486ce910-9c25-4c41-b022-cad6539337be" (UID: "486ce910-9c25-4c41-b022-cad6539337be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.411458 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.411433    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util" (OuterVolumeSpecName: "util") pod "4586b486-e4d3-4c8a-9366-798e0470f81a" (UID: "4586b486-e4d3-4c8a-9366-798e0470f81a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:44.506303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506258    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfql\" (UniqueName: \"kubernetes.io/projected/4586b486-e4d3-4c8a-9366-798e0470f81a-kube-api-access-qwfql\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.506303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506293    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.506303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506306    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.506303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506313    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/486ce910-9c25-4c41-b022-cad6539337be-bundle\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.506626 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506322    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4586b486-e4d3-4c8a-9366-798e0470f81a-util\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:44.506626 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:44.506330    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfv5w\" (UniqueName: \"kubernetes.io/projected/486ce910-9c25-4c41-b022-cad6539337be-kube-api-access-cfv5w\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:13:45.050510 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.050405    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv"
Sep 17 14:13:45.050510 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.050416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw7vfv" event={"ID":"4586b486-e4d3-4c8a-9366-798e0470f81a","Type":"ContainerDied","Data":"e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53"}
Sep 17 14:13:45.050724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.050513    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e47befe78c3589b72d060cdc6ef1575e8d7d020dba8713c0a4347975e7b03f53"
Sep 17 14:13:45.052590 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.052528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm" event={"ID":"486ce910-9c25-4c41-b022-cad6539337be","Type":"ContainerDied","Data":"fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e"}
Sep 17 14:13:45.052752 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.052608    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc84abf920abe8fab616cddaeeb2707ca34400282a13ef8ff06cd011efa51b6e"
Sep 17 14:13:45.052752 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.052536    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c62bljm"
Sep 17 14:13:45.054743 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.054710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944" event={"ID":"07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3","Type":"ContainerDied","Data":"8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663"}
Sep 17 14:13:45.054868 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.054761    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8623508d8850b3842d161b5bcbfcaca81dd699996518b42e0b2eae5f8229c663"
Sep 17 14:13:45.054868 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.054720    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpc944"
Sep 17 14:13:45.056890 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.056861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4" event={"ID":"63096664-a2e1-456e-a404-ed31ba1cca44","Type":"ContainerDied","Data":"e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78"}
Sep 17 14:13:45.057025 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.056905    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e829981aaf36c50c8d85eaecd48e89522a791dcf36112814ccd5cadd238f9c78"
Sep 17 14:13:45.057025 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:45.056909    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d76pvn4"
Sep 17 14:13:53.329029 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.328987    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"]
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329272    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329282    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329293    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329301    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329307    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329314    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329323    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329328    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329334    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329339    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329345    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329350    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329356    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329361    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329368    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329373    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329379    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329384    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329394    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329399    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="util"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329404    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329409    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="extract"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329416    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="pull"
Sep 17 14:13:53.329423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329420    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="pull"
Sep 17 14:13:53.330139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329464    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4586b486-e4d3-4c8a-9366-798e0470f81a" containerName="extract"
Sep 17 14:13:53.330139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329471    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="486ce910-9c25-4c41-b022-cad6539337be" containerName="extract"
Sep 17 14:13:53.330139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329478    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63096664-a2e1-456e-a404-ed31ba1cca44" containerName="extract"
Sep 17 14:13:53.330139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.329486    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d8b455-d7f0-4fe0-8d3a-1f1f54fbaca3" containerName="extract"
Sep 17 14:13:53.331942 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.331924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:13:53.334759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.334734    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jfx4b\""
Sep 17 14:13:53.334759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.334737    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 14:13:53.335718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.335694    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 14:13:53.347289 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.347226    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"]
Sep 17 14:13:53.479675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.479638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsc9n\" (UniqueName: \"kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n\") pod \"limitador-operator-controller-manager-74495c69f8-rr87p\" (UID: \"dc591627-1e66-4890-a65c-096b2b37cc11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:13:53.580517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.580427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsc9n\" (UniqueName: \"kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n\") pod \"limitador-operator-controller-manager-74495c69f8-rr87p\" (UID: \"dc591627-1e66-4890-a65c-096b2b37cc11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:13:53.596296 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.596256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsc9n\" (UniqueName: \"kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n\") pod \"limitador-operator-controller-manager-74495c69f8-rr87p\" (UID: \"dc591627-1e66-4890-a65c-096b2b37cc11\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:13:53.643168 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.643130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:13:53.920045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:53.920015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"]
Sep 17 14:13:53.922764 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:13:53.922737    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc591627_1e66_4890_a65c_096b2b37cc11.slice/crio-dd31dd98ad037ba806e62b82c6370151cb26c8ee66a8ce7c8d7081a19dacb69e WatchSource:0}: Error finding container dd31dd98ad037ba806e62b82c6370151cb26c8ee66a8ce7c8d7081a19dacb69e: Status 404 returned error can't find the container with id dd31dd98ad037ba806e62b82c6370151cb26c8ee66a8ce7c8d7081a19dacb69e
Sep 17 14:13:54.102163 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:13:54.102119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p" event={"ID":"dc591627-1e66-4890-a65c-096b2b37cc11","Type":"ContainerStarted","Data":"dd31dd98ad037ba806e62b82c6370151cb26c8ee66a8ce7c8d7081a19dacb69e"}
Sep 17 14:14:00.558114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.558025    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bql2f"]
Sep 17 14:14:00.561446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.561423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:00.564171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.564140    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mtx4x\""
Sep 17 14:14:00.575209 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.575175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bql2f"]
Sep 17 14:14:00.744278 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.744228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9t2d\" (UniqueName: \"kubernetes.io/projected/8045c64c-a0d1-410f-9b94-4408326a1f01-kube-api-access-b9t2d\") pod \"authorino-operator-76b478bd78-bql2f\" (UID: \"8045c64c-a0d1-410f-9b94-4408326a1f01\") " pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:00.845339 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.845228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9t2d\" (UniqueName: \"kubernetes.io/projected/8045c64c-a0d1-410f-9b94-4408326a1f01-kube-api-access-b9t2d\") pod \"authorino-operator-76b478bd78-bql2f\" (UID: \"8045c64c-a0d1-410f-9b94-4408326a1f01\") " pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:00.856048 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.856012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9t2d\" (UniqueName: \"kubernetes.io/projected/8045c64c-a0d1-410f-9b94-4408326a1f01-kube-api-access-b9t2d\") pod \"authorino-operator-76b478bd78-bql2f\" (UID: \"8045c64c-a0d1-410f-9b94-4408326a1f01\") " pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:00.872872 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:00.872836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:01.164059 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:01.164031    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bql2f"]
Sep 17 14:14:01.166224 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:14:01.166197    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8045c64c_a0d1_410f_9b94_4408326a1f01.slice/crio-cbfa2cc54d2ed64c532aceac9979a823854534b64838edd50c142f3cbbef5be9 WatchSource:0}: Error finding container cbfa2cc54d2ed64c532aceac9979a823854534b64838edd50c142f3cbbef5be9: Status 404 returned error can't find the container with id cbfa2cc54d2ed64c532aceac9979a823854534b64838edd50c142f3cbbef5be9
Sep 17 14:14:02.147632 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:02.147587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f" event={"ID":"8045c64c-a0d1-410f-9b94-4408326a1f01","Type":"ContainerStarted","Data":"cbfa2cc54d2ed64c532aceac9979a823854534b64838edd50c142f3cbbef5be9"}
Sep 17 14:14:04.166093 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:04.166051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f" event={"ID":"8045c64c-a0d1-410f-9b94-4408326a1f01","Type":"ContainerStarted","Data":"dc56372b18eb714ab0f2fbce7e6f0a43e3c4d49dab466c4f410b77d3e1b556f3"}
Sep 17 14:14:04.166590 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:04.166164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:04.187137 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:04.187073    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f" podStartSLOduration=1.790803419 podStartE2EDuration="4.187054164s" totalImagesPullingTime="2.396250745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:04.185261286 +0000 UTC m=+539.894134102" watchObservedRunningTime="2026-09-17 14:14:04.187054164 +0000 UTC m=+539.895926979"
Sep 17 14:14:09.193595 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:09.193540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p" event={"ID":"dc591627-1e66-4890-a65c-096b2b37cc11","Type":"ContainerStarted","Data":"312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d"}
Sep 17 14:14:09.193977 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:09.193719    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:09.214629 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:09.214570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p" podStartSLOduration=1.094611825 podStartE2EDuration="16.21452899s" totalImagesPullingTime="15.119917165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:09.213355462 +0000 UTC m=+544.922228279" watchObservedRunningTime="2026-09-17 14:14:09.21452899 +0000 UTC m=+544.923401870"
Sep 17 14:14:15.173928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:15.173890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bql2f"
Sep 17 14:14:17.621924 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.621881    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"]
Sep 17 14:14:17.622385 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.622124    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" containerName="manager" containerID="cri-o://312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d" gracePeriod=2
Sep 17 14:14:17.624157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.624117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:17.630808 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.630737    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"]
Sep 17 14:14:17.636165 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:17.636042    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rr87p\" is forbidden: User \"system:node:ip-10-0-136-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-184.ec2.internal' and this object" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:17.652194 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.652148    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"]
Sep 17 14:14:17.652467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.652453    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" containerName="manager"
Sep 17 14:14:17.652467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.652467    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" containerName="manager"
Sep 17 14:14:17.652618 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.652530    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" containerName="manager"
Sep 17 14:14:17.654474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.654441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:17.656736 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:17.656698    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rr87p\" is forbidden: User \"system:node:ip-10-0-136-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-184.ec2.internal' and this object" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:17.669154 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.669109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"]
Sep 17 14:14:17.672110 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.672075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmzz5\" (UniqueName: \"kubernetes.io/projected/edc867f8-2033-40b8-93dd-b01dc2b6d44a-kube-api-access-hmzz5\") pod \"limitador-operator-controller-manager-74495c69f8-f5ss7\" (UID: \"edc867f8-2033-40b8-93dd-b01dc2b6d44a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:17.773515 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.773473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmzz5\" (UniqueName: \"kubernetes.io/projected/edc867f8-2033-40b8-93dd-b01dc2b6d44a-kube-api-access-hmzz5\") pod \"limitador-operator-controller-manager-74495c69f8-f5ss7\" (UID: \"edc867f8-2033-40b8-93dd-b01dc2b6d44a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:17.782144 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.782110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmzz5\" (UniqueName: \"kubernetes.io/projected/edc867f8-2033-40b8-93dd-b01dc2b6d44a-kube-api-access-hmzz5\") pod \"limitador-operator-controller-manager-74495c69f8-f5ss7\" (UID: \"edc867f8-2033-40b8-93dd-b01dc2b6d44a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:17.865957 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.865930    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:17.868256 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:17.868223    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rr87p\" is forbidden: User \"system:node:ip-10-0-136-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-184.ec2.internal' and this object" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:17.975788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.975748    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsc9n\" (UniqueName: \"kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n\") pod \"dc591627-1e66-4890-a65c-096b2b37cc11\" (UID: \"dc591627-1e66-4890-a65c-096b2b37cc11\") "
Sep 17 14:14:17.977984 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:17.977956    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n" (OuterVolumeSpecName: "kube-api-access-xsc9n") pod "dc591627-1e66-4890-a65c-096b2b37cc11" (UID: "dc591627-1e66-4890-a65c-096b2b37cc11"). InnerVolumeSpecName "kube-api-access-xsc9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:18.009907 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.009873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:18.077229 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.077200    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsc9n\" (UniqueName: \"kubernetes.io/projected/dc591627-1e66-4890-a65c-096b2b37cc11-kube-api-access-xsc9n\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:14:18.242712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.242615    2560 generic.go:356] "Generic (PLEG): container finished" podID="dc591627-1e66-4890-a65c-096b2b37cc11" containerID="312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d" exitCode=0
Sep 17 14:14:18.242712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.242666    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:18.242935 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.242721    2560 scope.go:117] "RemoveContainer" containerID="312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d"
Sep 17 14:14:18.245589 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:18.245561    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rr87p\" is forbidden: User \"system:node:ip-10-0-136-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-184.ec2.internal' and this object" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:18.251574 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.251543    2560 scope.go:117] "RemoveContainer" containerID="312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d"
Sep 17 14:14:18.251858 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:18.251838    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d\": container with ID starting with 312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d not found: ID does not exist" containerID="312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d"
Sep 17 14:14:18.251929 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.251867    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d"} err="failed to get container status \"312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d\": rpc error: code = NotFound desc = could not find container \"312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d\": container with ID starting with 312c49b69b9ed81d2e74e19782779ccf96a93e4a9dce0a8982d492586a79272d not found: ID does not exist"
Sep 17 14:14:18.252884 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:14:18.252861    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-rr87p\" is forbidden: User \"system:node:ip-10-0-136-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-184.ec2.internal' and this object" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr87p"
Sep 17 14:14:18.285283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.284200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"]
Sep 17 14:14:18.289271 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:14:18.289243    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc867f8_2033_40b8_93dd_b01dc2b6d44a.slice/crio-b36c6e8bacba34854e4fde26b808f6bd77788bdbc719df79cedf9f8ef6abde5f WatchSource:0}: Error finding container b36c6e8bacba34854e4fde26b808f6bd77788bdbc719df79cedf9f8ef6abde5f: Status 404 returned error can't find the container with id b36c6e8bacba34854e4fde26b808f6bd77788bdbc719df79cedf9f8ef6abde5f
Sep 17 14:14:18.787987 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:18.787947    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc591627-1e66-4890-a65c-096b2b37cc11" path="/var/lib/kubelet/pods/dc591627-1e66-4890-a65c-096b2b37cc11/volumes"
Sep 17 14:14:19.250572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:19.250515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7" event={"ID":"edc867f8-2033-40b8-93dd-b01dc2b6d44a","Type":"ContainerStarted","Data":"ee75efc2d550b9b1fae25ae993a1aaf6fcde141043a32615f5f24a4d0f8df44f"}
Sep 17 14:14:19.250746 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:19.250580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7" event={"ID":"edc867f8-2033-40b8-93dd-b01dc2b6d44a","Type":"ContainerStarted","Data":"b36c6e8bacba34854e4fde26b808f6bd77788bdbc719df79cedf9f8ef6abde5f"}
Sep 17 14:14:19.250746 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:19.250641    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:19.269409 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:19.269350    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7" podStartSLOduration=2.269332228 podStartE2EDuration="2.269332228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:19.267746241 +0000 UTC m=+554.976619057" watchObservedRunningTime="2026-09-17 14:14:19.269332228 +0000 UTC m=+554.978205043"
Sep 17 14:14:30.257166 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:30.257134    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f5ss7"
Sep 17 14:14:48.852987 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.852952    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:14:48.857215 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.857195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:48.859802 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.859777    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 14:14:48.859886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.859819    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h77dj\""
Sep 17 14:14:48.866801 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.866777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:14:48.907505 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.907467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:14:48.928816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.928779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca188fec-d519-40ad-8f95-ceeeda9d53a0-config-file\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:48.928994 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:48.928844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrvj\" (UniqueName: \"kubernetes.io/projected/ca188fec-d519-40ad-8f95-ceeeda9d53a0-kube-api-access-bsrvj\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.030234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.030196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrvj\" (UniqueName: \"kubernetes.io/projected/ca188fec-d519-40ad-8f95-ceeeda9d53a0-kube-api-access-bsrvj\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.030424 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.030252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca188fec-d519-40ad-8f95-ceeeda9d53a0-config-file\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.030948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.030927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca188fec-d519-40ad-8f95-ceeeda9d53a0-config-file\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.039185 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.039161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrvj\" (UniqueName: \"kubernetes.io/projected/ca188fec-d519-40ad-8f95-ceeeda9d53a0-kube-api-access-bsrvj\") pod \"limitador-limitador-84994f7ffc-2cskp\" (UID: \"ca188fec-d519-40ad-8f95-ceeeda9d53a0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.169166 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.169072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:49.452956 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:49.452927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:14:49.456075 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:14:49.456041    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca188fec_d519_40ad_8f95_ceeeda9d53a0.slice/crio-9cd1af2d115e2e5818f5a91715fea8705fa4fb06e2ba95019126ebdd11ed0334 WatchSource:0}: Error finding container 9cd1af2d115e2e5818f5a91715fea8705fa4fb06e2ba95019126ebdd11ed0334: Status 404 returned error can't find the container with id 9cd1af2d115e2e5818f5a91715fea8705fa4fb06e2ba95019126ebdd11ed0334
Sep 17 14:14:50.413494 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:50.413461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp" event={"ID":"ca188fec-d519-40ad-8f95-ceeeda9d53a0","Type":"ContainerStarted","Data":"9cd1af2d115e2e5818f5a91715fea8705fa4fb06e2ba95019126ebdd11ed0334"}
Sep 17 14:14:51.420270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:51.420235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp" event={"ID":"ca188fec-d519-40ad-8f95-ceeeda9d53a0","Type":"ContainerStarted","Data":"48469e93c9635353836dc3fa3d5ea3ea3556dd45a6d67cf93537985151e0a719"}
Sep 17 14:14:51.420693 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:51.420300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:14:51.441959 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:14:51.441896    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp" podStartSLOduration=2.150697946 podStartE2EDuration="3.44187617s" totalImagesPullingTime="1.291178224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:51.441319008 +0000 UTC m=+587.150191826" watchObservedRunningTime="2026-09-17 14:14:51.44187617 +0000 UTC m=+587.150748985"
Sep 17 14:15:02.427954 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:15:02.427921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2cskp"
Sep 17 14:16:02.100631 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:02.100580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:16:18.979476 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:18.979435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:16:30.597943 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:30.597906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:16:40.985848 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.985814    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"]
Sep 17 14:16:40.989513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.989490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:40.992307 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.992279    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 14:16:40.992462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.992280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dg4pv\""
Sep 17 14:16:40.992462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.992340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 14:16:40.992462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.992330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 14:16:40.999302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:40.999273    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"]
Sep 17 14:16:41.021024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.020992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.021024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.021029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.021271 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.021051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.021271 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.021112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a3573c-678b-4916-9d0f-9bb83624662c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.021271 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.021143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.021271 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.021174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ts9w\" (UniqueName: \"kubernetes.io/projected/a8a3573c-678b-4916-9d0f-9bb83624662c-kube-api-access-4ts9w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.121796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.121796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a3573c-678b-4916-9d0f-9bb83624662c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.121948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ts9w\" (UniqueName: \"kubernetes.io/projected/a8a3573c-678b-4916-9d0f-9bb83624662c-kube-api-access-4ts9w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122261 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.122235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122325 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.122280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.122387 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.122327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.124221 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.124203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a3573c-678b-4916-9d0f-9bb83624662c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.124496 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.124479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a3573c-678b-4916-9d0f-9bb83624662c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.131016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.130987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ts9w\" (UniqueName: \"kubernetes.io/projected/a8a3573c-678b-4916-9d0f-9bb83624662c-kube-api-access-4ts9w\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl\" (UID: \"a8a3573c-678b-4916-9d0f-9bb83624662c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.300541 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.300449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:41.573539 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.573510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"]
Sep 17 14:16:41.575800 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:16:41.575758    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a3573c_678b_4916_9d0f_9bb83624662c.slice/crio-9ac4fca1ad5fa3d4600f78a2a99bb2e8e8829266a19548251791d10be2fa7cfe WatchSource:0}: Error finding container 9ac4fca1ad5fa3d4600f78a2a99bb2e8e8829266a19548251791d10be2fa7cfe: Status 404 returned error can't find the container with id 9ac4fca1ad5fa3d4600f78a2a99bb2e8e8829266a19548251791d10be2fa7cfe
Sep 17 14:16:41.577061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.577041    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:16:41.997281 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:41.997205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl" event={"ID":"a8a3573c-678b-4916-9d0f-9bb83624662c","Type":"ContainerStarted","Data":"9ac4fca1ad5fa3d4600f78a2a99bb2e8e8829266a19548251791d10be2fa7cfe"}
Sep 17 14:16:42.195111 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:42.195072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:16:43.004082 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:43.004042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl" event={"ID":"a8a3573c-678b-4916-9d0f-9bb83624662c","Type":"ContainerStarted","Data":"a30452af46f8ab93f0d431e6f82b3fb75e4c98fcaa72a396c74ebc62fbf7e5a3"}
Sep 17 14:16:43.025426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:43.025372    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl" podStartSLOduration=1.992450545 podStartE2EDuration="3.025354597s" totalImagesPullingTime="1.032904052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:43.023720228 +0000 UTC m=+698.732593048" watchObservedRunningTime="2026-09-17 14:16:43.025354597 +0000 UTC m=+698.734227447"
Sep 17 14:16:51.300682 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:51.300635    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:51.301201 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:51.300718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:51.313535 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:51.313498    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:52.060428 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:52.060396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl"
Sep 17 14:16:55.691777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.691738    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"]
Sep 17 14:16:55.695085 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.695062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.697737 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.697704    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 14:16:55.705625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.705588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"]
Sep 17 14:16:55.734336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmtt\" (UniqueName: \"kubernetes.io/projected/2c36d768-151c-434d-9176-3e705c5946d4-kube-api-access-9pmtt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.734336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.734588 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.734588 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.734588 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c36d768-151c-434d-9176-3e705c5946d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.734688 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.734569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835349 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c36d768-151c-434d-9176-3e705c5946d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835349 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835651 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmtt\" (UniqueName: \"kubernetes.io/projected/2c36d768-151c-434d-9176-3e705c5946d4-kube-api-access-9pmtt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835651 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835651 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835651 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835860 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835921 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.835973 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.835938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.837799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.837778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c36d768-151c-434d-9176-3e705c5946d4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.838106 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.838086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c36d768-151c-434d-9176-3e705c5946d4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:55.844810 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:55.844783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmtt\" (UniqueName: \"kubernetes.io/projected/2c36d768-151c-434d-9176-3e705c5946d4-kube-api-access-9pmtt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vsg8x\" (UID: \"2c36d768-151c-434d-9176-3e705c5946d4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:56.006940 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:56.006845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:16:56.283525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:56.283499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"]
Sep 17 14:16:56.284871 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:16:56.284840    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c36d768_151c_434d_9176_3e705c5946d4.slice/crio-7b5f119ca69fe73aa63d72a8976f38cbf25e394c4e0f69d2e2620b25ea8e27a9 WatchSource:0}: Error finding container 7b5f119ca69fe73aa63d72a8976f38cbf25e394c4e0f69d2e2620b25ea8e27a9: Status 404 returned error can't find the container with id 7b5f119ca69fe73aa63d72a8976f38cbf25e394c4e0f69d2e2620b25ea8e27a9
Sep 17 14:16:56.900129 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:56.894870    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:16:57.077403 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:57.077363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x" event={"ID":"2c36d768-151c-434d-9176-3e705c5946d4","Type":"ContainerStarted","Data":"ea52a7f368f95dbc7b32dc25276ab2047138b1e66b184ee5d55709f13b10c0b6"}
Sep 17 14:16:57.077615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:57.077424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x" event={"ID":"2c36d768-151c-434d-9176-3e705c5946d4","Type":"ContainerStarted","Data":"7b5f119ca69fe73aa63d72a8976f38cbf25e394c4e0f69d2e2620b25ea8e27a9"}
Sep 17 14:16:57.102978 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:16:57.102913    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x" podStartSLOduration=1.882324454 podStartE2EDuration="2.10289542s" totalImagesPullingTime="220.570966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:57.1016279 +0000 UTC m=+712.810500708" watchObservedRunningTime="2026-09-17 14:16:57.10289542 +0000 UTC m=+712.811768227"
Sep 17 14:17:06.007516 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:06.007466    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:17:06.007959 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:06.007578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:17:06.020042 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:06.020011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:17:06.133620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:06.133584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vsg8x"
Sep 17 14:17:09.505391 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:09.505347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:17:18.597964 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.597921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"]
Sep 17 14:17:18.600767 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.600742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.603314 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.603277    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 17 14:17:18.614892 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.613728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"]
Sep 17 14:17:18.736576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.736774 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774f16a1-df6b-41df-891b-1f49e1391c15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.736774 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5svg\" (UniqueName: \"kubernetes.io/projected/774f16a1-df6b-41df-891b-1f49e1391c15-kube-api-access-z5svg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.736774 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.736901 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.736901 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.736849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838135 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774f16a1-df6b-41df-891b-1f49e1391c15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5svg\" (UniqueName: \"kubernetes.io/projected/774f16a1-df6b-41df-891b-1f49e1391c15-kube-api-access-z5svg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838674 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.838674 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.838647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.840530 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.840509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/774f16a1-df6b-41df-891b-1f49e1391c15-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.840814 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.840793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/774f16a1-df6b-41df-891b-1f49e1391c15-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.846693 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.846666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5svg\" (UniqueName: \"kubernetes.io/projected/774f16a1-df6b-41df-891b-1f49e1391c15-kube-api-access-z5svg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bsnj4\" (UID: \"774f16a1-df6b-41df-891b-1f49e1391c15\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:18.911980 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:18.911883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:19.190511 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:19.190485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"]
Sep 17 14:17:19.192878 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:17:19.192851    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774f16a1_df6b_41df_891b_1f49e1391c15.slice/crio-4ad265d7f37f102847c94bab28ce3bde8ef45c81a06f16b7951ee24dfb0de40a WatchSource:0}: Error finding container 4ad265d7f37f102847c94bab28ce3bde8ef45c81a06f16b7951ee24dfb0de40a: Status 404 returned error can't find the container with id 4ad265d7f37f102847c94bab28ce3bde8ef45c81a06f16b7951ee24dfb0de40a
Sep 17 14:17:20.196543 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:20.196507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4" event={"ID":"774f16a1-df6b-41df-891b-1f49e1391c15","Type":"ContainerStarted","Data":"f56c8f5536bd87f6952fe9d7195a4144b24a9364d16e7049f0888f774499933b"}
Sep 17 14:17:20.196958 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:20.196594    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4" event={"ID":"774f16a1-df6b-41df-891b-1f49e1391c15","Type":"ContainerStarted","Data":"4ad265d7f37f102847c94bab28ce3bde8ef45c81a06f16b7951ee24dfb0de40a"}
Sep 17 14:17:20.230846 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:20.230789    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4" podStartSLOduration=2.059533667 podStartE2EDuration="2.230770936s" totalImagesPullingTime="171.237269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:17:20.229787561 +0000 UTC m=+735.938660377" watchObservedRunningTime="2026-09-17 14:17:20.230770936 +0000 UTC m=+735.939643748"
Sep 17 14:17:20.491044 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:20.490946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:17:28.912395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:28.912350    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:28.912916 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:28.912433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:28.925180 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:28.925151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:29.254023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:29.253993    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bsnj4"
Sep 17 14:17:34.981030 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:17:34.980982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:18:55.590934 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:55.590890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:18:57.613858 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.613801    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:18:57.617311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.617282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.620088 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.620055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 14:18:57.620259 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.620142    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d65tq\""
Sep 17 14:18:57.620332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.620320    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 14:18:57.621209 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.621186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 14:18:57.621318 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.621186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-fcd9f3-serving-cert\""
Sep 17 14:18:57.628381 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.628346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:18:57.642423 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.642383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27vn\" (UniqueName: \"kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.642619 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.642451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.642619 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.642487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.642619 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.642527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.743579 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.743531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27vn\" (UniqueName: \"kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.743796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.743589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.743796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.743609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.743796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.743636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.744357 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.744326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.746302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.746270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.746410 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.746311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.753952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.753922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27vn\" (UniqueName: \"kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn\") pod \"maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:57.928590 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:57.928451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:18:58.211645 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.211611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:18:58.213256 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:18:58.213221    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf613931b_5fb1_4792_af0b_05ab02972c56.slice/crio-47b234a3f04bcf773a5b858175dfc58314489b110ecc81b4e1ff082d9e8b7c07 WatchSource:0}: Error finding container 47b234a3f04bcf773a5b858175dfc58314489b110ecc81b4e1ff082d9e8b7c07: Status 404 returned error can't find the container with id 47b234a3f04bcf773a5b858175dfc58314489b110ecc81b4e1ff082d9e8b7c07
Sep 17 14:18:58.269150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.269112    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:18:58.277117 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.277078    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.279969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.279934    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-fcd9f3\""
Sep 17 14:18:58.280125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.280046    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-fcd9f3-dockercfg-q4nhc\""
Sep 17 14:18:58.291411 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.291380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:18:58.349276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.349238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.349468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.349298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dxv\" (UniqueName: \"kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.450725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.450664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dxv\" (UniqueName: \"kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.450926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.450793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.451487 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.451467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.461231 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.461148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dxv\" (UniqueName: \"kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv\") pod \"payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.591756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.591712    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:18:58.719368 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.719265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" event={"ID":"f613931b-5fb1-4792-af0b-05ab02972c56","Type":"ContainerStarted","Data":"47b234a3f04bcf773a5b858175dfc58314489b110ecc81b4e1ff082d9e8b7c07"}
Sep 17 14:18:58.877748 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:58.877697    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:18:58.881424 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:18:58.881388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec99946_acd6_4b66_8479_634e2b5d8cee.slice/crio-62e33b70c2261b0b9d9f4125782f1013a9af64b6336098a54618c0964eb1d62a WatchSource:0}: Error finding container 62e33b70c2261b0b9d9f4125782f1013a9af64b6336098a54618c0964eb1d62a: Status 404 returned error can't find the container with id 62e33b70c2261b0b9d9f4125782f1013a9af64b6336098a54618c0964eb1d62a
Sep 17 14:18:59.726871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:18:59.726821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" event={"ID":"dec99946-acd6-4b66-8479-634e2b5d8cee","Type":"ContainerStarted","Data":"62e33b70c2261b0b9d9f4125782f1013a9af64b6336098a54618c0964eb1d62a"}
Sep 17 14:19:00.736660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.736480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" event={"ID":"f613931b-5fb1-4792-af0b-05ab02972c56","Type":"ContainerStarted","Data":"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"}
Sep 17 14:19:00.737340 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.737308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:19:00.762735 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.760298    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" podStartSLOduration=1.431271961 podStartE2EDuration="3.760276443s" totalImagesPullingTime="2.329004482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:00.758379816 +0000 UTC m=+836.467252633" watchObservedRunningTime="2026-09-17 14:19:00.760276443 +0000 UTC m=+836.469149263"
Sep 17 14:19:00.821911 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.821622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:00.826680 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.826651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.829367 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.829343    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ccd499b1-openshift-default-dockercfg-mtqsv\""
Sep 17 14:19:00.843487 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.843445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:00.876474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876791 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876791 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876791 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtfl\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.876972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.876893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.977741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.977692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.977741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.977750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.977778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.977804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.977990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtfl\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978355 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.978355 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.979125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.979125 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.978795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.979383 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.979358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.980893 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.980871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.981119 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.981095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.990024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.989963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:00.990221 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:00.990183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtfl\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl\") pod \"e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") " pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:01.139738 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.139645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:01.608194 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.608164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:01.610205 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:01.610173    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db9255f_543f_43fe_9409_41590a9c12dc.slice/crio-b1d763f2e7d8df8bba1e8af3bb1d19f6b47199499629dbb20d3f0a473908cc0b WatchSource:0}: Error finding container b1d763f2e7d8df8bba1e8af3bb1d19f6b47199499629dbb20d3f0a473908cc0b: Status 404 returned error can't find the container with id b1d763f2e7d8df8bba1e8af3bb1d19f6b47199499629dbb20d3f0a473908cc0b
Sep 17 14:19:01.743928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.743884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" event={"ID":"dec99946-acd6-4b66-8479-634e2b5d8cee","Type":"ContainerStarted","Data":"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"}
Sep 17 14:19:01.744401 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.744055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:19:01.745276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.745252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerStarted","Data":"b1d763f2e7d8df8bba1e8af3bb1d19f6b47199499629dbb20d3f0a473908cc0b"}
Sep 17 14:19:01.763838 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:01.763777    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" podStartSLOduration=1.261955363 podStartE2EDuration="3.763757644s" totalImagesPullingTime="2.501802281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:01.761969298 +0000 UTC m=+837.470842116" watchObservedRunningTime="2026-09-17 14:19:01.763757644 +0000 UTC m=+837.472630850"
Sep 17 14:19:04.347730 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:04.347693    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:04.347983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:04.347775    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:04.347983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:04.347810    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:04.770959 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:04.770917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerStarted","Data":"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"}
Sep 17 14:19:04.793103 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:04.793017    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podStartSLOduration=2.058122123 podStartE2EDuration="4.793000981s" totalImagesPullingTime="2.734878858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:04.791237788 +0000 UTC m=+840.500110603" watchObservedRunningTime="2026-09-17 14:19:04.793000981 +0000 UTC m=+840.501873797"
Sep 17 14:19:05.140311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:05.140218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:05.145272 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:05.145239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:05.775932 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:05.775894    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:05.776862 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:05.776840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:06.751039 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:06.751009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:19:10.505827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.505787    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:19:10.510823 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.510799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.513226 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.513199    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-3f6f32-serving-cert\""
Sep 17 14:19:10.520438 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.520084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:19:10.570168 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.570129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.570365 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.570199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.570365 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.570261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.570365 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.570340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjtd9\" (UniqueName: \"kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.670947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.670905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjtd9\" (UniqueName: \"kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.671157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.670973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.671157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.671016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.671157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.671056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.671744 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.671712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.673416 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.673389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.673530 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.673512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.679207 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.679177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjtd9\" (UniqueName: \"kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9\") pod \"maas-api-e2e-autores-3f6f32-876bd4987-nlmw8\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:10.823829 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:10.823719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:11.100099 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:11.100067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:19:11.101470 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:11.101443    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd3ec2_ec53_4434_ae16_dbf9dad15937.slice/crio-c0c30383d522f44ef9027731a21bac5758ef6c48c89b017c0b065399e8ef54c5 WatchSource:0}: Error finding container c0c30383d522f44ef9027731a21bac5758ef6c48c89b017c0b065399e8ef54c5: Status 404 returned error can't find the container with id c0c30383d522f44ef9027731a21bac5758ef6c48c89b017c0b065399e8ef54c5
Sep 17 14:19:11.814224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:11.814147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" event={"ID":"12fd3ec2-ec53-4434-ae16-dbf9dad15937","Type":"ContainerStarted","Data":"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"}
Sep 17 14:19:11.814224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:11.814201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" event={"ID":"12fd3ec2-ec53-4434-ae16-dbf9dad15937","Type":"ContainerStarted","Data":"c0c30383d522f44ef9027731a21bac5758ef6c48c89b017c0b065399e8ef54c5"}
Sep 17 14:19:11.814643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:11.814271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:11.833821 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:11.833764    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" podStartSLOduration=1.486431539 podStartE2EDuration="1.833743694s" totalImagesPullingTime="347.312155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:11.831580766 +0000 UTC m=+847.540453574" watchObservedRunningTime="2026-09-17 14:19:11.833743694 +0000 UTC m=+847.542616510"
Sep 17 14:19:12.757036 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:12.757007    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:19:14.389581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:14.389524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:19:15.255101 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.255065    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:19:15.259429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.259399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.262090 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.262062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9b8115-openshift-default-dockercfg-brntj\""
Sep 17 14:19:15.276962 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.276928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:19:15.315034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.314994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7db2\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315418 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315418 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315418 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.315418 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.315329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.416834 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7db2\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.416977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.417827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.417784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.419362 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.419339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.419612 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.419591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.425251 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.425223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.425615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.425593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7db2\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2\") pod \"e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") " pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.574778 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.574688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:15.860532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.860502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:19:15.863072 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:15.863042    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a060f48_a702_4fd8_b946_08b55f1bbbc3.slice/crio-2448a0ae154ec576b0b67686d0199b55f0b066b44c990a42ffe350dbd90ea59b WatchSource:0}: Error finding container 2448a0ae154ec576b0b67686d0199b55f0b066b44c990a42ffe350dbd90ea59b: Status 404 returned error can't find the container with id 2448a0ae154ec576b0b67686d0199b55f0b066b44c990a42ffe350dbd90ea59b
Sep 17 14:19:15.865616 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.865586    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:15.865703 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.865649    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:15.865703 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:15.865677    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:16.849364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:16.849304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerStarted","Data":"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"}
Sep 17 14:19:16.849897 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:16.849396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerStarted","Data":"2448a0ae154ec576b0b67686d0199b55f0b066b44c990a42ffe350dbd90ea59b"}
Sep 17 14:19:16.872506 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:16.872443    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podStartSLOduration=1.872423508 podStartE2EDuration="1.872423508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:16.870654163 +0000 UTC m=+852.579526980" watchObservedRunningTime="2026-09-17 14:19:16.872423508 +0000 UTC m=+852.581296324"
Sep 17 14:19:17.575074 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:17.575031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:17.580481 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:17.580451    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:17.825817 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:17.825736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:19:17.858477 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:17.858427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:17.862889 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:17.862851    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:20.199026 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.198980    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:19:20.203272 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.203240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.205900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.205872    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9b8115-serving-cert\""
Sep 17 14:19:20.220667 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.220593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:19:20.268534 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.268478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.268770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.268594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.268770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.268648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.268770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.268741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7mn\" (UniqueName: \"kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.369608 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.369559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.369824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.369633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.369824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.369694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.369824 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.369733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7mn\" (UniqueName: \"kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.370419 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.370390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.372259 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.372233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.372370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.372257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.378083 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.378052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7mn\" (UniqueName: \"kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn\") pod \"maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.515845 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.515735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:20.827570 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.827530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:19:20.829238 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:20.829206    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7aa7734_66bf_4748_bba1_cb2c98460a94.slice/crio-519ac7b3b84553bff0819bed479d2c5a26efe9cf54757627d7960c9d4cdf3c78 WatchSource:0}: Error finding container 519ac7b3b84553bff0819bed479d2c5a26efe9cf54757627d7960c9d4cdf3c78: Status 404 returned error can't find the container with id 519ac7b3b84553bff0819bed479d2c5a26efe9cf54757627d7960c9d4cdf3c78
Sep 17 14:19:20.877910 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:20.877820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" event={"ID":"e7aa7734-66bf-4748-bba1-cb2c98460a94","Type":"ContainerStarted","Data":"519ac7b3b84553bff0819bed479d2c5a26efe9cf54757627d7960c9d4cdf3c78"}
Sep 17 14:19:21.114828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.114728    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:19:21.119592 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.119538    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.122192 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.122165    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-9b8115\""
Sep 17 14:19:21.129909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.129879    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:19:21.178663 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.178626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.178663 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.178667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsjqp\" (UniqueName: \"kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.227009 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.226965    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:19:21.231013 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.230943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.235299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.235265    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-9b8115-dockercfg-kk6km\""
Sep 17 14:19:21.279839 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.279797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:19:21.281023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.280987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.281262 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.281239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsjqp\" (UniqueName: \"kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.282905 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.282853    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.293906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.293868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsjqp\" (UniqueName: \"kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp\") pod \"payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.382142 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.382028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdr8x\" (UniqueName: \"kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.382142 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.382099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.432944 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.432885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.483189 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.483149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdr8x\" (UniqueName: \"kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.483394 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.483209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.483930 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.483910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.491997 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.491969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdr8x\" (UniqueName: \"kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x\") pod \"payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.577196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.577149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:21.736935 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.735989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:19:21.738929 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:21.738894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00282529_ac54_4c4b_8b2c_6eb1ec00ea73.slice/crio-a7ccb8554fa0759c10309760ee4bcb34e71badaea2318a4029e41a20b83ff4b8 WatchSource:0}: Error finding container a7ccb8554fa0759c10309760ee4bcb34e71badaea2318a4029e41a20b83ff4b8: Status 404 returned error can't find the container with id a7ccb8554fa0759c10309760ee4bcb34e71badaea2318a4029e41a20b83ff4b8
Sep 17 14:19:21.882724 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.882692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:19:21.887537 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:21.887500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7383eba8_fef2_40b0_b7ed_eb5eeeedc9eb.slice/crio-4e1e0364627ab4c92801e97cffba29f38695c0fa2d98203f2aa66a0850819540 WatchSource:0}: Error finding container 4e1e0364627ab4c92801e97cffba29f38695c0fa2d98203f2aa66a0850819540: Status 404 returned error can't find the container with id 4e1e0364627ab4c92801e97cffba29f38695c0fa2d98203f2aa66a0850819540
Sep 17 14:19:21.887703 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.887646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" event={"ID":"00282529-ac54-4c4b-8b2c-6eb1ec00ea73","Type":"ContainerStarted","Data":"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"}
Sep 17 14:19:21.887782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.887706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" event={"ID":"00282529-ac54-4c4b-8b2c-6eb1ec00ea73","Type":"ContainerStarted","Data":"a7ccb8554fa0759c10309760ee4bcb34e71badaea2318a4029e41a20b83ff4b8"}
Sep 17 14:19:21.887782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.887753    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:21.889689 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.889659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" event={"ID":"e7aa7734-66bf-4748-bba1-cb2c98460a94","Type":"ContainerStarted","Data":"97de80c04ba1d5caaf97e508e61f21bb48199b27eca149cbacf0240f4c563de7"}
Sep 17 14:19:21.889792 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.889771    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:21.910906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.910842    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" podStartSLOduration=0.910819543 podStartE2EDuration="910.819543ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:21.906048112 +0000 UTC m=+857.614920930" watchObservedRunningTime="2026-09-17 14:19:21.910819543 +0000 UTC m=+857.619692361"
Sep 17 14:19:21.929189 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:21.928990    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" podStartSLOduration=1.16730147 podStartE2EDuration="1.92896481s" totalImagesPullingTime="761.66334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:21.92686234 +0000 UTC m=+857.635735167" watchObservedRunningTime="2026-09-17 14:19:21.92896481 +0000 UTC m=+857.637837628"
Sep 17 14:19:22.899425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:22.899382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" event={"ID":"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb","Type":"ContainerStarted","Data":"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"}
Sep 17 14:19:22.899911 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:22.899454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" event={"ID":"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb","Type":"ContainerStarted","Data":"4e1e0364627ab4c92801e97cffba29f38695c0fa2d98203f2aa66a0850819540"}
Sep 17 14:19:22.899911 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:22.899567    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:22.919588 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:22.919496    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" podStartSLOduration=1.919471604 podStartE2EDuration="1.919471604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:22.918655052 +0000 UTC m=+858.627527871" watchObservedRunningTime="2026-09-17 14:19:22.919471604 +0000 UTC m=+858.628344421"
Sep 17 14:19:24.913623 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.913587    2560 generic.go:356] "Generic (PLEG): container finished" podID="1db9255f-543f-43fe-9409-41590a9c12dc" containerID="1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca" exitCode=0
Sep 17 14:19:24.914057 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.913663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerDied","Data":"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"}
Sep 17 14:19:24.914167 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.914148    2560 scope.go:117] "RemoveContainer" containerID="1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"
Sep 17 14:19:24.915379 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.915346    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:24.915472 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.915420    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:24.915472 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:24.915455    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:25.923066 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:25.923016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerStarted","Data":"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"}
Sep 17 14:19:26.140186 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:26.140078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:26.141224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:26.140834    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:26.141224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:26.140908    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:27.140447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:27.140397    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:27.141128 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:27.141092    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:27.905491 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:27.905459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:19:28.148578 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:28.144053    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:28.148578 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:28.144130    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:29.140801 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:29.140757    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:29.141163 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:29.141128    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:30.140350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:30.140299    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:30.140878 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:30.140378    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:31.141114 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:31.141063    2560 patch_prober.go:28] interesting pod/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 17 14:19:31.141728 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:31.141688    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 17 14:19:32.178573 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.177884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:32.182574 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.179293    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:32.193176 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.193011    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:32.415061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.415022    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:32.902239 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.902206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:19:32.978325 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:32.978288    2560 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" secret="" err="secret \"e2e-ait-ccd499b1-openshift-default-dockercfg-mtqsv\" not found"
Sep 17 14:19:33.453257 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.453206    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:19:33.460902 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.460866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.468744 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.468711    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9e4372d6-gw-openshift-default-dockercfg-zq5xg\""
Sep 17 14:19:33.473805 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.473766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:19:33.621616 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.621843 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.621843 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.621843 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.621843 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.621843 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.622093 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.622093 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.622093 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.621987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9zs\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9zs\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723625 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.723926 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.723828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.724268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.724236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.724604 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.724578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.726243 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.726208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.726406 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.726356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.732212 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.732178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.732212 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.732194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9zs\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs\") pod \"e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") " pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.782513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.782469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:33.907271 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.907240    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:19:33.984514 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:33.984427    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy" containerID="cri-o://4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb" gracePeriod=30
Sep 17 14:19:34.111601 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.111535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:19:34.113096 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:19:34.113064    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc20c59_2ace_46ee_8970_f49bc822b5ca.slice/crio-85787cfbc40381b63253fe80d1c491cd2647a5fa563ff8dec1f9501bcdd9c954 WatchSource:0}: Error finding container 85787cfbc40381b63253fe80d1c491cd2647a5fa563ff8dec1f9501bcdd9c954: Status 404 returned error can't find the container with id 85787cfbc40381b63253fe80d1c491cd2647a5fa563ff8dec1f9501bcdd9c954
Sep 17 14:19:34.115883 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.115850    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:34.115969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.115920    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:34.115969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.115952    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:34.993222 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.993176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerStarted","Data":"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"}
Sep 17 14:19:34.993691 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:34.993252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerStarted","Data":"85787cfbc40381b63253fe80d1c491cd2647a5fa563ff8dec1f9501bcdd9c954"}
Sep 17 14:19:35.017358 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:35.017235    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podStartSLOduration=2.017217481 podStartE2EDuration="2.017217481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:19:35.01488312 +0000 UTC m=+870.723755937" watchObservedRunningTime="2026-09-17 14:19:35.017217481 +0000 UTC m=+870.726090296"
Sep 17 14:19:35.783661 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:35.783613    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:35.789526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:35.789492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:35.999411 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:35.999372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:36.000587 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:36.000534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:36.797190 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:36.797148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:19:38.013068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.012979    2560 generic.go:356] "Generic (PLEG): container finished" podID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerID="f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd" exitCode=0
Sep 17 14:19:38.013068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.013054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerDied","Data":"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"}
Sep 17 14:19:38.013589 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.013569    2560 scope.go:117] "RemoveContainer" containerID="f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"
Sep 17 14:19:38.014831 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.014802    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:38.014919 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.014870    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:38.014919 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:38.014901    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:39.021293 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.021257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerStarted","Data":"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"}
Sep 17 14:19:39.233228 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.233190    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.282845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.282919    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.282949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwtfl\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket\") pod \"1db9255f-543f-43fe-9409-41590a9c12dc\" (UID: \"1db9255f-543f-43fe-9409-41590a9c12dc\") "
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.283815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:19:39.284268 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.284000    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:19:39.284938 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.284488    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:19:39.284938 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.284508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:19:39.284938 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.284608    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:19:39.288012 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.287946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl" (OuterVolumeSpecName: "kube-api-access-kwtfl") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "kube-api-access-kwtfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:19:39.291752 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.291426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:19:39.291752 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.291692    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:19:39.292113 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.292076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1db9255f-543f-43fe-9409-41590a9c12dc" (UID: "1db9255f-543f-43fe-9409-41590a9c12dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:19:39.384335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384290    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384326    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1db9255f-543f-43fe-9409-41590a9c12dc-istiod-ca-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384336    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384344    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-workload-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384353    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-envoy\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384362    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-credential-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384370    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1db9255f-543f-43fe-9409-41590a9c12dc-istio-data\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384378    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1db9255f-543f-43fe-9409-41590a9c12dc-istio-podinfo\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.384677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.384386    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwtfl\" (UniqueName: \"kubernetes.io/projected/1db9255f-543f-43fe-9409-41590a9c12dc-kube-api-access-kwtfl\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:19:39.575291 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.575195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:39.575588 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.575533    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:39.575695 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:39.575637    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:40.031151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.031118    2560 generic.go:356] "Generic (PLEG): container finished" podID="1db9255f-543f-43fe-9409-41590a9c12dc" containerID="4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb" exitCode=0
Sep 17 14:19:40.031572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.031191    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"
Sep 17 14:19:40.031572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.031189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerDied","Data":"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"}
Sep 17 14:19:40.031572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.031327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr" event={"ID":"1db9255f-543f-43fe-9409-41590a9c12dc","Type":"ContainerDied","Data":"b1d763f2e7d8df8bba1e8af3bb1d19f6b47199499629dbb20d3f0a473908cc0b"}
Sep 17 14:19:40.031572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.031350    2560 scope.go:117] "RemoveContainer" containerID="4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"
Sep 17 14:19:40.063039 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.061759    2560 scope.go:117] "RemoveContainer" containerID="1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"
Sep 17 14:19:40.073766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.073745    2560 scope.go:117] "RemoveContainer" containerID="4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"
Sep 17 14:19:40.074133 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:19:40.074104    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb\": container with ID starting with 4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb not found: ID does not exist" containerID="4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"
Sep 17 14:19:40.074201 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.074148    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb"} err="failed to get container status \"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb\": rpc error: code = NotFound desc = could not find container \"4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb\": container with ID starting with 4643fcfe93999fb8bf80251ae6e6a066244d838dcf077f061ace7616e70a7cdb not found: ID does not exist"
Sep 17 14:19:40.074201 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.074172    2560 scope.go:117] "RemoveContainer" containerID="1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"
Sep 17 14:19:40.074481 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:19:40.074461    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca\": container with ID starting with 1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca not found: ID does not exist" containerID="1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"
Sep 17 14:19:40.074539 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.074490    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca"} err="failed to get container status \"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca\": rpc error: code = NotFound desc = could not find container \"1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca\": container with ID starting with 1914695b02804668e0d1453d23efba94cd95c91e5c87ca3d3a50e18ff1d652ca not found: ID does not exist"
Sep 17 14:19:40.083700 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.083662    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:40.090872 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.090823    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr"]
Sep 17 14:19:40.575453 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.575416    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:40.575695 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.575493    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:40.789648 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:40.789610    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" path="/var/lib/kubelet/pods/1db9255f-543f-43fe-9409-41590a9c12dc/volumes"
Sep 17 14:19:41.575800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:41.575756    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:41.576241 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:41.575846    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:42.575116 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:42.575076    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:42.575333 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:42.575144    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:43.575967 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:43.575925    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:43.576631 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:43.575992    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:44.576178 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:44.576135    2560 patch_prober.go:28] interesting pod/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 14:19:44.576642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:44.576198    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 14:19:45.579807 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:45.579770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:45.580197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:45.580082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:45.580969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:45.580947    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:19:55.187825 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:55.187776    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:19:56.148918 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.148877    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerID="3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee" exitCode=0
Sep 17 14:19:56.149139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.148946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerDied","Data":"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"}
Sep 17 14:19:56.149459 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.149437    2560 scope.go:117] "RemoveContainer" containerID="3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"
Sep 17 14:19:56.150679 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.150651    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:56.150747 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.150725    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:56.150794 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:56.150778    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:19:57.161676 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:57.161633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerStarted","Data":"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"}
Sep 17 14:19:57.782818 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:57.782774    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:19:57.783159 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:57.783130    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 14:19:57.783227 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:57.783198    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 14:19:58.783115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:58.783070    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 14:19:58.783519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:58.783141    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 14:19:59.783759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:59.783708    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 14:19:59.784182 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:19:59.783801    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 14:20:00.783132 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:00.783082    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 14:20:00.783378 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:00.783144    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 14:20:01.783137 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:01.783099    2560 patch_prober.go:28] interesting pod/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 14:20:01.783597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:01.783152    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 14:20:03.011070 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:03.011030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:20:03.012028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:03.011997    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:20:03.013411 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:03.013391    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:20:08.215871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.215825    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:20:08.216328 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.216099    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy" containerID="cri-o://7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd" gracePeriod=30
Sep 17 14:20:08.962061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962017    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:08.962732 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962683    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:08.962732 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962711    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:08.962732 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962729    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:08.963028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962739    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:08.963028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.962868    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:08.966170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.966137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:08.968884 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.968855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-60f59148-openshift-default-dockercfg-8jfbv\""
Sep 17 14:20:08.980012 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:08.979979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:09.081080 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081687 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf9v4\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081687 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081687 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.081687 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.081461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.182777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.182777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183078 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183078 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf9v4\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183078 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183078 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.182939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183583 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183686 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.183992 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.183971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.185593 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.185565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.185731 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.185687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.192517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.192479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.192748 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.192632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf9v4\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4\") pod \"e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") " pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.280168 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.280050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:09.567569 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.567523    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:09.569423 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:20:09.569395    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3001efd1_dd8b_46a6_81ef_345a1f9316e7.slice/crio-c5ee4d303eecd9b37ddd002ff4c33a4c6c0c0a0aba84d0516421b7b8cdfb8535 WatchSource:0}: Error finding container c5ee4d303eecd9b37ddd002ff4c33a4c6c0c0a0aba84d0516421b7b8cdfb8535: Status 404 returned error can't find the container with id c5ee4d303eecd9b37ddd002ff4c33a4c6c0c0a0aba84d0516421b7b8cdfb8535
Sep 17 14:20:09.572477 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.572438    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:09.572617 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.572528    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:09.572677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:09.572628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:10.246287 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.246241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerStarted","Data":"ce57179602998d56db504cbbc806f50b87def0e117d94deb7fc007683b7dbf95"}
Sep 17 14:20:10.246526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.246373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerStarted","Data":"c5ee4d303eecd9b37ddd002ff4c33a4c6c0c0a0aba84d0516421b7b8cdfb8535"}
Sep 17 14:20:10.272502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.272431    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podStartSLOduration=2.272412588 podStartE2EDuration="2.272412588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:20:10.270306837 +0000 UTC m=+905.979179654" watchObservedRunningTime="2026-09-17 14:20:10.272412588 +0000 UTC m=+905.981285403"
Sep 17 14:20:10.280478 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.280438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:10.286072 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.286040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:10.306618 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:10.306581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:20:11.252304 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:11.252270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:11.253481 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:11.253461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:13.476782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.476717    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:20:13.526336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526366    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq9zs\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526475    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526619    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert\") pod \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\" (UID: \"3fc20c59-2ace-46ee-8970-f49bc822b5ca\") "
Sep 17 14:20:13.526922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526724    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:13.526922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:13.527067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.526913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:13.527129 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.527036    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-data\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.527129 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.527105    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-credential-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.527129 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.527115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:13.527292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.527123    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.527292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.527258    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:13.528864 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.528840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:13.529000 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.528906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:20:13.529242 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.529225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:20:13.529287 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.529238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs" (OuterVolumeSpecName: "kube-api-access-rq9zs") pod "3fc20c59-2ace-46ee-8970-f49bc822b5ca" (UID: "3fc20c59-2ace-46ee-8970-f49bc822b5ca"). InnerVolumeSpecName "kube-api-access-rq9zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:20:13.628002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.627964    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istiod-ca-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.628002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.627997    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-envoy\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.628002 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.628008    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq9zs\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-kube-api-access-rq9zs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.628281 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.628017    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-podinfo\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.628281 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.628027    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc20c59-2ace-46ee-8970-f49bc822b5ca-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:13.628281 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:13.628036    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc20c59-2ace-46ee-8970-f49bc822b5ca-workload-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:14.270957 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.270916    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerID="7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd" exitCode=0
Sep 17 14:20:14.271248 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.270969    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"
Sep 17 14:20:14.271248 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.271002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerDied","Data":"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"}
Sep 17 14:20:14.271248 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.271065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj" event={"ID":"3fc20c59-2ace-46ee-8970-f49bc822b5ca","Type":"ContainerDied","Data":"85787cfbc40381b63253fe80d1c491cd2647a5fa563ff8dec1f9501bcdd9c954"}
Sep 17 14:20:14.271248 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.271087    2560 scope.go:117] "RemoveContainer" containerID="7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"
Sep 17 14:20:14.287105 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.287081    2560 scope.go:117] "RemoveContainer" containerID="3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"
Sep 17 14:20:14.297449 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.297417    2560 scope.go:117] "RemoveContainer" containerID="7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"
Sep 17 14:20:14.297845 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:20:14.297816    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd\": container with ID starting with 7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd not found: ID does not exist" containerID="7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"
Sep 17 14:20:14.297963 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.297856    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd"} err="failed to get container status \"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd\": rpc error: code = NotFound desc = could not find container \"7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd\": container with ID starting with 7ee63072face20adee2236113e53d3c1774a76e1fadd17f92bd4deb1e4ff2ffd not found: ID does not exist"
Sep 17 14:20:14.297963 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.297884    2560 scope.go:117] "RemoveContainer" containerID="3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"
Sep 17 14:20:14.298288 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:20:14.298222    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee\": container with ID starting with 3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee not found: ID does not exist" containerID="3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"
Sep 17 14:20:14.298288 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.298262    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee"} err="failed to get container status \"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee\": rpc error: code = NotFound desc = could not find container \"3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee\": container with ID starting with 3a365274aefd6965097a53673ba108850930644ea34f817200e367d6d6482fee not found: ID does not exist"
Sep 17 14:20:14.299539 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.299513    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:20:14.302962 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.302932    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj"]
Sep 17 14:20:14.789063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:14.789025    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" path="/var/lib/kubelet/pods/3fc20c59-2ace-46ee-8970-f49bc822b5ca/volumes"
Sep 17 14:20:18.373755 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.373710    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:20:18.374179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374117    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.374179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374129    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.374179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374143    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.374179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374149    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.374368 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374207    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db9255f-543f-43fe-9409-41590a9c12dc" containerName="istio-proxy"
Sep 17 14:20:18.374368 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374215    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.374368 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.374224    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc20c59-2ace-46ee-8970-f49bc822b5ca" containerName="istio-proxy"
Sep 17 14:20:18.377152 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.377133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.380968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.380936    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-3f6f32\"/\"default-dockercfg-nx897\""
Sep 17 14:20:18.380968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.380957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-3f6f32\"/\"openshift-service-ca.crt\""
Sep 17 14:20:18.381167 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.380996    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-3f6f32\"/\"autores-model-3f6f32-kserve-self-signed-certs\""
Sep 17 14:20:18.381167 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.381010    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-3f6f32\"/\"kube-root-ca.crt\""
Sep 17 14:20:18.388415 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.388385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:20:18.471496 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.471496 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66kkt\" (UniqueName: \"kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.471784 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.471784 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.471784 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.471900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.471838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66kkt\" (UniqueName: \"kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574447 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574704 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.574764 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.574732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.575147 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.575118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.575356 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.575331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.581219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.577910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.581219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.578233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.585109 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.585067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66kkt\" (UniqueName: \"kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt\") pod \"autores-model-3f6f32-kserve-7f845cbc95-kvwph\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") " pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.687852 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.687814    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:18.964601 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:18.964572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:20:18.966383 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:20:18.966343    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8efbf951_bad8_4ddc_9c20_4b112312b6a3.slice/crio-00155edf63d2b2c290d627a18af2090206bd82b87313464488ce64673331c7a8 WatchSource:0}: Error finding container 00155edf63d2b2c290d627a18af2090206bd82b87313464488ce64673331c7a8: Status 404 returned error can't find the container with id 00155edf63d2b2c290d627a18af2090206bd82b87313464488ce64673331c7a8
Sep 17 14:20:19.305909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:19.305809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" event={"ID":"8efbf951-bad8-4ddc-9c20-4b112312b6a3","Type":"ContainerStarted","Data":"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"}
Sep 17 14:20:19.305909 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:19.305861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" event={"ID":"8efbf951-bad8-4ddc-9c20-4b112312b6a3","Type":"ContainerStarted","Data":"00155edf63d2b2c290d627a18af2090206bd82b87313464488ce64673331c7a8"}
Sep 17 14:20:19.325618 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:19.325538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" podStartSLOduration=1.325519888 podStartE2EDuration="1.325519888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:20:19.323196729 +0000 UTC m=+915.032069547" watchObservedRunningTime="2026-09-17 14:20:19.325519888 +0000 UTC m=+915.034392701"
Sep 17 14:20:27.294752 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:27.294699    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 14:20:27.295223 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:27.294776    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 14:20:28.688219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:28.688166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:28.688666 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:28.688244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:28.701003 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:28.700968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:29.366692 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.366660    2560 generic.go:356] "Generic (PLEG): container finished" podID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerID="ce57179602998d56db504cbbc806f50b87def0e117d94deb7fc007683b7dbf95" exitCode=0
Sep 17 14:20:29.366953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.366739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerDied","Data":"ce57179602998d56db504cbbc806f50b87def0e117d94deb7fc007683b7dbf95"}
Sep 17 14:20:29.367232 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.367213    2560 scope.go:117] "RemoveContainer" containerID="ce57179602998d56db504cbbc806f50b87def0e117d94deb7fc007683b7dbf95"
Sep 17 14:20:29.368406 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.368370    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:29.368513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.368445    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:29.368513 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.368483    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:20:29.378592 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:29.378566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:20:30.211636 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:30.211597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:20:30.374725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:30.374689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerStarted","Data":"aaf46b9d85261675d59f8e8a987a668b30ebc45e98552cb1c9e862965f8a82ad"}
Sep 17 14:20:31.280895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:31.280842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:31.281305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:31.281091    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 17 14:20:31.281305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:31.281159    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 17 14:20:32.281432 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:32.281383    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 17 14:20:32.281871 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:32.281479    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 17 14:20:33.280718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:33.280676    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 17 14:20:33.280905 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:33.280748    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 17 14:20:34.281350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:34.281309    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 17 14:20:34.281807 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:34.281384    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 17 14:20:35.281344 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:35.281304    2560 patch_prober.go:28] interesting pod/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 17 14:20:35.281539 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:35.281377    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 17 14:20:36.284396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:36.284361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:36.284854 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:36.284693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:36.285511 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:36.285494    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:44.262731 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:44.262691    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:44.263179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:44.262964    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy" containerID="cri-o://aaf46b9d85261675d59f8e8a987a668b30ebc45e98552cb1c9e862965f8a82ad" gracePeriod=30
Sep 17 14:20:49.487091 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.487052    2560 generic.go:356] "Generic (PLEG): container finished" podID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerID="aaf46b9d85261675d59f8e8a987a668b30ebc45e98552cb1c9e862965f8a82ad" exitCode=0
Sep 17 14:20:49.487580 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.487122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerDied","Data":"aaf46b9d85261675d59f8e8a987a668b30ebc45e98552cb1c9e862965f8a82ad"}
Sep 17 14:20:49.487580 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.487192    2560 scope.go:117] "RemoveContainer" containerID="ce57179602998d56db504cbbc806f50b87def0e117d94deb7fc007683b7dbf95"
Sep 17 14:20:49.540947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.540865    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:49.674790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.674790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674888    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674929    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.674978    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf9v4\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675026    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675054    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data\") pod \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\" (UID: \"3001efd1-dd8b-46a6-81ef-345a1f9316e7\") "
Sep 17 14:20:49.675429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:49.675429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:49.675429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:49.675429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:49.675429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675408    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.675680 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675429    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-credential-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.675680 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675453    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-workload-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.675680 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675471    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istiod-ca-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.675680 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.675410    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:49.677266 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.677230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:20:49.677266 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.677240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:20:49.677541 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.677526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:20:49.677635 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.677543    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4" (OuterVolumeSpecName: "kube-api-access-sf9v4") pod "3001efd1-dd8b-46a6-81ef-345a1f9316e7" (UID: "3001efd1-dd8b-46a6-81ef-345a1f9316e7"). InnerVolumeSpecName "kube-api-access-sf9v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:20:49.776024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.775975    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf9v4\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-kube-api-access-sf9v4\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.776024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.776014    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-envoy\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.776024 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.776027    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.776282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.776040    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-data\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:49.776282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:49.776053    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3001efd1-dd8b-46a6-81ef-345a1f9316e7-istio-podinfo\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:20:50.494457 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.494428    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"
Sep 17 14:20:50.494916 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.494475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g" event={"ID":"3001efd1-dd8b-46a6-81ef-345a1f9316e7","Type":"ContainerDied","Data":"c5ee4d303eecd9b37ddd002ff4c33a4c6c0c0a0aba84d0516421b7b8cdfb8535"}
Sep 17 14:20:50.494916 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.494544    2560 scope.go:117] "RemoveContainer" containerID="aaf46b9d85261675d59f8e8a987a668b30ebc45e98552cb1c9e862965f8a82ad"
Sep 17 14:20:50.517251 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.517200    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:50.519559 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.519524    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g"]
Sep 17 14:20:50.789678 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:50.789587    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" path="/var/lib/kubelet/pods/3001efd1-dd8b-46a6-81ef-345a1f9316e7/volumes"
Sep 17 14:20:52.390008 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:20:52.389959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:21:01.078908 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.078864    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:21:01.079312 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.079247    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:21:01.079312 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.079259    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:21:01.079389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.079345    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:21:01.079389 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.079353    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:21:01.081664 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.081641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.085686 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.085655    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-181b16\"/\"kube-root-ca.crt\""
Sep 17 14:21:01.085865 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.085655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-181b16\"/\"default-dockercfg-lqlqr\""
Sep 17 14:21:01.085865 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.085663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-181b16\"/\"test-model-181b16-kserve-self-signed-certs\""
Sep 17 14:21:01.085865 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.085809    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-181b16\"/\"openshift-service-ca.crt\""
Sep 17 14:21:01.100049 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.100008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:21:01.176063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.176063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsj7w\" (UniqueName: \"kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.176390 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.176390 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.176390 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.176390 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.176239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.276782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.276782 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsj7w\" (UniqueName: \"kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.276905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.277231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277284 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.277255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.277377 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.277303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.279326 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.279300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.279610 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.279589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.286949 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.286913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsj7w\" (UniqueName: \"kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w\") pod \"test-model-181b16-kserve-59ccb6d7d7-8pwqn\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") " pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.391809 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.391700    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:01.668880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:01.668847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:21:01.670518 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:21:01.670485    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e98df20_30d0_4e83_a59a_08a3bc14533f.slice/crio-045a7a0f7f7dc08f556c375eef7f358c18029acd5fd07ec12af63671c6e6e059 WatchSource:0}: Error finding container 045a7a0f7f7dc08f556c375eef7f358c18029acd5fd07ec12af63671c6e6e059: Status 404 returned error can't find the container with id 045a7a0f7f7dc08f556c375eef7f358c18029acd5fd07ec12af63671c6e6e059
Sep 17 14:21:02.570234 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:02.570188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" event={"ID":"2e98df20-30d0-4e83-a59a-08a3bc14533f","Type":"ContainerStarted","Data":"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"}
Sep 17 14:21:02.570740 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:02.570243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" event={"ID":"2e98df20-30d0-4e83-a59a-08a3bc14533f","Type":"ContainerStarted","Data":"045a7a0f7f7dc08f556c375eef7f358c18029acd5fd07ec12af63671c6e6e059"}
Sep 17 14:21:02.591526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:02.591465    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" podStartSLOduration=1.5914448939999999 podStartE2EDuration="1.591444894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:02.588837471 +0000 UTC m=+958.297710288" watchObservedRunningTime="2026-09-17 14:21:02.591444894 +0000 UTC m=+958.300317709"
Sep 17 14:21:04.254442 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.254396    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:21:04.254952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.254702    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" podUID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" containerName="maas-api" containerID="cri-o://6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d" gracePeriod=30
Sep 17 14:21:04.513303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.513226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:21:04.584437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.584402    2560 generic.go:356] "Generic (PLEG): container finished" podID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" containerID="6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d" exitCode=0
Sep 17 14:21:04.584643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.584449    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"
Sep 17 14:21:04.584643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.584487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" event={"ID":"12fd3ec2-ec53-4434-ae16-dbf9dad15937","Type":"ContainerDied","Data":"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"}
Sep 17 14:21:04.584643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.584544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8" event={"ID":"12fd3ec2-ec53-4434-ae16-dbf9dad15937","Type":"ContainerDied","Data":"c0c30383d522f44ef9027731a21bac5758ef6c48c89b017c0b065399e8ef54c5"}
Sep 17 14:21:04.584643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.584583    2560 scope.go:117] "RemoveContainer" containerID="6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"
Sep 17 14:21:04.600942 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.600892    2560 scope.go:117] "RemoveContainer" containerID="6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"
Sep 17 14:21:04.601396 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:21:04.601358    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d\": container with ID starting with 6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d not found: ID does not exist" containerID="6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"
Sep 17 14:21:04.601497 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.601401    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d"} err="failed to get container status \"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d\": rpc error: code = NotFound desc = could not find container \"6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d\": container with ID starting with 6f317ef3d0ad667d4a03d17dbbb65a35dd282aeed7316bae9f4a0e399bf8992d not found: ID does not exist"
Sep 17 14:21:04.606758 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.606731    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs\") pod \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") "
Sep 17 14:21:04.606936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.606791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca\") pod \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") "
Sep 17 14:21:04.606936 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.606886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjtd9\" (UniqueName: \"kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9\") pod \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") "
Sep 17 14:21:04.607028 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.606938    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls\") pod \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\" (UID: \"12fd3ec2-ec53-4434-ae16-dbf9dad15937\") "
Sep 17 14:21:04.607241 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.607206    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12fd3ec2-ec53-4434-ae16-dbf9dad15937" (UID: "12fd3ec2-ec53-4434-ae16-dbf9dad15937"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:21:04.609179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.609147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9" (OuterVolumeSpecName: "kube-api-access-jjtd9") pod "12fd3ec2-ec53-4434-ae16-dbf9dad15937" (UID: "12fd3ec2-ec53-4434-ae16-dbf9dad15937"). InnerVolumeSpecName "kube-api-access-jjtd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:21:04.609302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.609227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "12fd3ec2-ec53-4434-ae16-dbf9dad15937" (UID: "12fd3ec2-ec53-4434-ae16-dbf9dad15937"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:21:04.609302 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.609236    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12fd3ec2-ec53-4434-ae16-dbf9dad15937" (UID: "12fd3ec2-ec53-4434-ae16-dbf9dad15937"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:21:04.708412 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.708362    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjtd9\" (UniqueName: \"kubernetes.io/projected/12fd3ec2-ec53-4434-ae16-dbf9dad15937-kube-api-access-jjtd9\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:04.708412 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.708407    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:04.708412 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.708417    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fd3ec2-ec53-4434-ae16-dbf9dad15937-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:04.708412 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.708425    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12fd3ec2-ec53-4434-ae16-dbf9dad15937-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:04.902128 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.902093    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:21:04.908974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:04.908933    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3f6f32-876bd4987-nlmw8"]
Sep 17 14:21:06.789026 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:06.788982    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" path="/var/lib/kubelet/pods/12fd3ec2-ec53-4434-ae16-dbf9dad15937/volumes"
Sep 17 14:21:09.092541 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:09.092501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:21:09.821392 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:09.821353    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:21:11.392684 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:11.392643    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:11.393198 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:11.392808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:11.405948 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:11.405912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:11.634155 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:11.634120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:21:24.841429 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:24.841383    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" podUID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" containerName="main" containerID="cri-o://a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546" gracePeriod=45
Sep 17 14:21:25.095570 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.095474    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:21:25.192468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192476    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192504    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192526    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66kkt\" (UniqueName: \"kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192662    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache\") pod \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\" (UID: \"8efbf951-bad8-4ddc-9c20-4b112312b6a3\") "
Sep 17 14:21:25.192969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192792    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:21:25.192969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home" (OuterVolumeSpecName: "home") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:21:25.192969 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192943    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache" (OuterVolumeSpecName: "model-cache") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:21:25.193099 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.192996    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tmp-dir\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.193099 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.193014    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-home\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.194904 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.194864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt" (OuterVolumeSpecName: "kube-api-access-66kkt") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "kube-api-access-66kkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:21:25.194904 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.194881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:21:25.194904 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.194872    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm" (OuterVolumeSpecName: "dshm") pod "8efbf951-bad8-4ddc-9c20-4b112312b6a3" (UID: "8efbf951-bad8-4ddc-9c20-4b112312b6a3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:21:25.293725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.293677    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efbf951-bad8-4ddc-9c20-4b112312b6a3-tls-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.293725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.293714    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-model-cache\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.293725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.293724    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efbf951-bad8-4ddc-9c20-4b112312b6a3-dshm\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.293725 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.293734    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66kkt\" (UniqueName: \"kubernetes.io/projected/8efbf951-bad8-4ddc-9c20-4b112312b6a3-kube-api-access-66kkt\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:21:25.707364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.707327    2560 generic.go:356] "Generic (PLEG): container finished" podID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" containerID="a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546" exitCode=0
Sep 17 14:21:25.707615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.707370    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"
Sep 17 14:21:25.707615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.707409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" event={"ID":"8efbf951-bad8-4ddc-9c20-4b112312b6a3","Type":"ContainerDied","Data":"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"}
Sep 17 14:21:25.707615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.707463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph" event={"ID":"8efbf951-bad8-4ddc-9c20-4b112312b6a3","Type":"ContainerDied","Data":"00155edf63d2b2c290d627a18af2090206bd82b87313464488ce64673331c7a8"}
Sep 17 14:21:25.707615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.707487    2560 scope.go:117] "RemoveContainer" containerID="a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"
Sep 17 14:21:25.717770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.717743    2560 scope.go:117] "RemoveContainer" containerID="a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"
Sep 17 14:21:25.718104 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:21:25.718082    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546\": container with ID starting with a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546 not found: ID does not exist" containerID="a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"
Sep 17 14:21:25.718167 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.718113    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546"} err="failed to get container status \"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546\": rpc error: code = NotFound desc = could not find container \"a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546\": container with ID starting with a75ce80254b612bb375d750ad3ab71c5acd53327bbe489b132f36b3d514c0546 not found: ID does not exist"
Sep 17 14:21:25.731426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.731386    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:21:25.735424 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:25.735390    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-3f6f32/autores-model-3f6f32-kserve-7f845cbc95-kvwph"]
Sep 17 14:21:26.788895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:26.788808    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" path="/var/lib/kubelet/pods/8efbf951-bad8-4ddc-9c20-4b112312b6a3/volumes"
Sep 17 14:21:27.985314 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:21:27.985268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:22:09.802329 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802289    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802707    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" containerName="maas-api"
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802722    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" containerName="maas-api"
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802732    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802738    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3001efd1-dd8b-46a6-81ef-345a1f9316e7" containerName="istio-proxy"
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802748    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" containerName="main"
Sep 17 14:22:09.802795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802754    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" containerName="main"
Sep 17 14:22:09.802990 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802826    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fd3ec2-ec53-4434-ae16-dbf9dad15937" containerName="maas-api"
Sep 17 14:22:09.802990 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.802839    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8efbf951-bad8-4ddc-9c20-4b112312b6a3" containerName="main"
Sep 17 14:22:09.805697 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.805679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:09.808362 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.808342    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-68183c-dockercfg-52dds\""
Sep 17 14:22:09.808442 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.808416    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-68183c\""
Sep 17 14:22:09.816675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.816648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:22:09.900887 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.900850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fvqk\" (UniqueName: \"kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:09.901067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:09.900907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.001732 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.001689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fvqk\" (UniqueName: \"kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.001944 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.001758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.002502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.002476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.011258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.011232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fvqk\" (UniqueName: \"kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk\") pod \"payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.117770 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.117685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.393800 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.393770    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:22:10.395926 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:22:10.395893    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06093d82_9c2d_46b3_a08e_59481a9487a4.slice/crio-069fbd117c8780e698667339cbb714fdce9dd643f1c5a1545e136cd5326a360f WatchSource:0}: Error finding container 069fbd117c8780e698667339cbb714fdce9dd643f1c5a1545e136cd5326a360f: Status 404 returned error can't find the container with id 069fbd117c8780e698667339cbb714fdce9dd643f1c5a1545e136cd5326a360f
Sep 17 14:22:10.962462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.962424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" event={"ID":"06093d82-9c2d-46b3-a08e-59481a9487a4","Type":"ContainerStarted","Data":"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"}
Sep 17 14:22:10.962933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.962489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" event={"ID":"06093d82-9c2d-46b3-a08e-59481a9487a4","Type":"ContainerStarted","Data":"069fbd117c8780e698667339cbb714fdce9dd643f1c5a1545e136cd5326a360f"}
Sep 17 14:22:10.962933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.962559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:10.981474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:10.981414    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" podStartSLOduration=1.98139733 podStartE2EDuration="1.98139733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:10.978819255 +0000 UTC m=+1026.687692071" watchObservedRunningTime="2026-09-17 14:22:10.98139733 +0000 UTC m=+1026.690270146"
Sep 17 14:22:19.693526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:19.693476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:22:21.970001 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:21.969963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:22:36.409497 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.409463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:22:36.412869 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.412852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.416622 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.416602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-fcd9f3\"/\"openshift-service-ca.crt\""
Sep 17 14:22:36.416852 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.416831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-fcd9f3\"/\"premium-w4-fcd9f3-kserve-self-signed-certs\""
Sep 17 14:22:36.416916 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.416831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-fcd9f3\"/\"kube-root-ca.crt\""
Sep 17 14:22:36.416916 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.416867    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-fcd9f3\"/\"default-dockercfg-9sc5l\""
Sep 17 14:22:36.422990 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.422967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:22:36.539968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.539930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.539968 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.539976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.540196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.540034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.540196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.540071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82wlm\" (UniqueName: \"kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.540196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.540138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.540196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.540161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641586 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641586 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641837 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641837 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82wlm\" (UniqueName: \"kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641837 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.641837 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.642047 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.641992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.642108 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.642045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.642108 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.642070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.643997 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.643975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.644170 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.644153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.649654 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.649634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82wlm\" (UniqueName: \"kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm\") pod \"premium-w4-fcd9f3-kserve-6bd8f59549-t46jp\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") " pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.723714 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.723670    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:36.995199 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:36.995172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:22:36.996992 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:22:36.996965    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0292f6dc_8ac7_45c7_92f7_fdf671ae3214.slice/crio-3cb58c7989a5b9e68f4ec5188170ba7cb196eb661548afe9fe485cbbfa61f945 WatchSource:0}: Error finding container 3cb58c7989a5b9e68f4ec5188170ba7cb196eb661548afe9fe485cbbfa61f945: Status 404 returned error can't find the container with id 3cb58c7989a5b9e68f4ec5188170ba7cb196eb661548afe9fe485cbbfa61f945
Sep 17 14:22:37.106949 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:37.106909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" event={"ID":"0292f6dc-8ac7-45c7-92f7-fdf671ae3214","Type":"ContainerStarted","Data":"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"}
Sep 17 14:22:37.107143 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:37.106964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" event={"ID":"0292f6dc-8ac7-45c7-92f7-fdf671ae3214","Type":"ContainerStarted","Data":"3cb58c7989a5b9e68f4ec5188170ba7cb196eb661548afe9fe485cbbfa61f945"}
Sep 17 14:22:37.127132 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:37.127075    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" podStartSLOduration=1.127056013 podStartE2EDuration="1.127056013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:37.125560065 +0000 UTC m=+1052.834432874" watchObservedRunningTime="2026-09-17 14:22:37.127056013 +0000 UTC m=+1052.835928859"
Sep 17 14:22:42.690690 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:42.690652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:22:46.724847 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:46.724807    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:46.724847 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:46.724858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:46.737819 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:46.737779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:22:47.176186 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:22:47.176110    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:23:06.318160 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.318078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:06.321071 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.321054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.323386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.323362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2137c903\""
Sep 17 14:23:06.333597 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.333574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:06.340698 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.340671    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:06.343972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.343954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.346620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.346597    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2137c903-dockercfg-wp5n2\""
Sep 17 14:23:06.356223 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.356195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:06.408756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.408717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl6qf\" (UniqueName: \"kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.408776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.408893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrwf\" (UniqueName: \"kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.408945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.509855 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.509815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.510091 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.509873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrwf\" (UniqueName: \"kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.510091 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.509913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.510091 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.509961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl6qf\" (UniqueName: \"kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.510670 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.510644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.510772 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.510646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.518263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.518227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrwf\" (UniqueName: \"kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf\") pod \"payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.518396 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.518309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl6qf\" (UniqueName: \"kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf\") pod \"payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") " pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.632506 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.632415    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:06.655633 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.655473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:06.908264 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.908232    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:06.909657 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:23:06.909633    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756f4bb8_5ea7_41a2_be88_7edd0c8957ab.slice/crio-5a266b73c1838c656adca3db6e2b73c65ef709d407ed85372242629c99686ff4 WatchSource:0}: Error finding container 5a266b73c1838c656adca3db6e2b73c65ef709d407ed85372242629c99686ff4: Status 404 returned error can't find the container with id 5a266b73c1838c656adca3db6e2b73c65ef709d407ed85372242629c99686ff4
Sep 17 14:23:06.945133 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:06.945101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:06.955727 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:23:06.955698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52910e29_4cd6_42c5_b685_1f9c652275c7.slice/crio-b85d0bfdf6548586f2436861738f1879804a2c33045304e0269cf70387c22507 WatchSource:0}: Error finding container b85d0bfdf6548586f2436861738f1879804a2c33045304e0269cf70387c22507: Status 404 returned error can't find the container with id b85d0bfdf6548586f2436861738f1879804a2c33045304e0269cf70387c22507
Sep 17 14:23:07.285095 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.285055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" event={"ID":"52910e29-4cd6-42c5-b685-1f9c652275c7","Type":"ContainerStarted","Data":"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"}
Sep 17 14:23:07.285300 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.285122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" event={"ID":"52910e29-4cd6-42c5-b685-1f9c652275c7","Type":"ContainerStarted","Data":"b85d0bfdf6548586f2436861738f1879804a2c33045304e0269cf70387c22507"}
Sep 17 14:23:07.285300 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.285187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:07.286814 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.286788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" event={"ID":"756f4bb8-5ea7-41a2-be88-7edd0c8957ab","Type":"ContainerStarted","Data":"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"}
Sep 17 14:23:07.286923 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.286830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" event={"ID":"756f4bb8-5ea7-41a2-be88-7edd0c8957ab","Type":"ContainerStarted","Data":"5a266b73c1838c656adca3db6e2b73c65ef709d407ed85372242629c99686ff4"}
Sep 17 14:23:07.286923 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.286852    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:07.306332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.306275    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" podStartSLOduration=1.306258274 podStartE2EDuration="1.306258274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:23:07.304354422 +0000 UTC m=+1083.013227239" watchObservedRunningTime="2026-09-17 14:23:07.306258274 +0000 UTC m=+1083.015131089"
Sep 17 14:23:07.325535 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:07.325469    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" podStartSLOduration=1.325445399 podStartE2EDuration="1.325445399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:23:07.32225152 +0000 UTC m=+1083.031124338" watchObservedRunningTime="2026-09-17 14:23:07.325445399 +0000 UTC m=+1083.034318217"
Sep 17 14:23:09.896101 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:09.896058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:23:18.294308 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:18.294275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:18.294929 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:18.294352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:47.995850 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:47.995802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:23:50.231544 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.231505    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:50.232159 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.231864    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" podUID="52910e29-4cd6-42c5-b685-1f9c652275c7" containerName="payload-processing" containerID="cri-o://ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42" gracePeriod=30
Sep 17 14:23:50.238183 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.238151    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:50.238490 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.238445    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" podUID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" containerName="payload-pre-processing" containerID="cri-o://b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59" gracePeriod=30
Sep 17 14:23:50.533249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.533215    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:50.535739 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.535710    2560 generic.go:356] "Generic (PLEG): container finished" podID="52910e29-4cd6-42c5-b685-1f9c652275c7" containerID="ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42" exitCode=0
Sep 17 14:23:50.535739 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.535745    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"
Sep 17 14:23:50.535947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.535839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" event={"ID":"52910e29-4cd6-42c5-b685-1f9c652275c7","Type":"ContainerDied","Data":"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"}
Sep 17 14:23:50.535947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.535887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67" event={"ID":"52910e29-4cd6-42c5-b685-1f9c652275c7","Type":"ContainerDied","Data":"b85d0bfdf6548586f2436861738f1879804a2c33045304e0269cf70387c22507"}
Sep 17 14:23:50.535947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.535909    2560 scope.go:117] "RemoveContainer" containerID="ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"
Sep 17 14:23:50.536943 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.536915    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:50.543781 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.539087    2560 generic.go:356] "Generic (PLEG): container finished" podID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" containerID="b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59" exitCode=0
Sep 17 14:23:50.543781 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.539217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" event={"ID":"756f4bb8-5ea7-41a2-be88-7edd0c8957ab","Type":"ContainerDied","Data":"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"}
Sep 17 14:23:50.543781 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.539307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg" event={"ID":"756f4bb8-5ea7-41a2-be88-7edd0c8957ab","Type":"ContainerDied","Data":"5a266b73c1838c656adca3db6e2b73c65ef709d407ed85372242629c99686ff4"}
Sep 17 14:23:50.552694 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.552664    2560 scope.go:117] "RemoveContainer" containerID="ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"
Sep 17 14:23:50.553086 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:23:50.553058    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42\": container with ID starting with ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42 not found: ID does not exist" containerID="ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"
Sep 17 14:23:50.553196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.553093    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42"} err="failed to get container status \"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42\": rpc error: code = NotFound desc = could not find container \"ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42\": container with ID starting with ce56c38b69a5dfc146f421da2c0e1f93f5d9ca87c20f03ea8b56b7ffda979f42 not found: ID does not exist"
Sep 17 14:23:50.553196 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.553114    2560 scope.go:117] "RemoveContainer" containerID="b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"
Sep 17 14:23:50.564361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.564338    2560 scope.go:117] "RemoveContainer" containerID="b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"
Sep 17 14:23:50.564764 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:23:50.564742    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59\": container with ID starting with b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59 not found: ID does not exist" containerID="b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"
Sep 17 14:23:50.564839 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.564777    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59"} err="failed to get container status \"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59\": rpc error: code = NotFound desc = could not find container \"b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59\": container with ID starting with b98bc15c2dd74347385a6b063e5ad1f193b3e8d471421dc6782e3811ed7aea59 not found: ID does not exist"
Sep 17 14:23:50.618277 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl6qf\" (UniqueName: \"kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf\") pod \"52910e29-4cd6-42c5-b685-1f9c652275c7\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") "
Sep 17 14:23:50.618277 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618283    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume\") pod \"52910e29-4cd6-42c5-b685-1f9c652275c7\" (UID: \"52910e29-4cd6-42c5-b685-1f9c652275c7\") "
Sep 17 14:23:50.618522 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume\") pod \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") "
Sep 17 14:23:50.618522 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618345    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvrwf\" (UniqueName: \"kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf\") pod \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\" (UID: \"756f4bb8-5ea7-41a2-be88-7edd0c8957ab\") "
Sep 17 14:23:50.618775 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52910e29-4cd6-42c5-b685-1f9c652275c7" (UID: "52910e29-4cd6-42c5-b685-1f9c652275c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:23:50.618827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.618760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "756f4bb8-5ea7-41a2-be88-7edd0c8957ab" (UID: "756f4bb8-5ea7-41a2-be88-7edd0c8957ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:23:50.620559 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.620520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf" (OuterVolumeSpecName: "kube-api-access-pvrwf") pod "756f4bb8-5ea7-41a2-be88-7edd0c8957ab" (UID: "756f4bb8-5ea7-41a2-be88-7edd0c8957ab"). InnerVolumeSpecName "kube-api-access-pvrwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:23:50.620646 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.620576    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf" (OuterVolumeSpecName: "kube-api-access-sl6qf") pod "52910e29-4cd6-42c5-b685-1f9c652275c7" (UID: "52910e29-4cd6-42c5-b685-1f9c652275c7"). InnerVolumeSpecName "kube-api-access-sl6qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:23:50.720240 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.720203    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvrwf\" (UniqueName: \"kubernetes.io/projected/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-kube-api-access-pvrwf\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:23:50.720514 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.720480    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl6qf\" (UniqueName: \"kubernetes.io/projected/52910e29-4cd6-42c5-b685-1f9c652275c7-kube-api-access-sl6qf\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:23:50.720514 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.720509    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52910e29-4cd6-42c5-b685-1f9c652275c7-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:23:50.720727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.720522    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f4bb8-5ea7-41a2-be88-7edd0c8957ab-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:23:50.852708 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.852665    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:50.859508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:50.859468    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67"]
Sep 17 14:23:51.546405 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:51.546311    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"
Sep 17 14:23:51.563803 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:51.563758    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:51.568020 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:51.567976    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg"]
Sep 17 14:23:52.788899 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:52.788856    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52910e29-4cd6-42c5-b685-1f9c652275c7" path="/var/lib/kubelet/pods/52910e29-4cd6-42c5-b685-1f9c652275c7/volumes"
Sep 17 14:23:52.789411 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:23:52.789388    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" path="/var/lib/kubelet/pods/756f4bb8-5ea7-41a2-be88-7edd0c8957ab/volumes"
Sep 17 14:24:04.623697 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.623663    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:24:04.624475 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.624420    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" podUID="06093d82-9c2d-46b3-a08e-59481a9487a4" containerName="payload-pre-processing" containerID="cri-o://7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808" gracePeriod=30
Sep 17 14:24:04.890366 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.890290    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:24:04.950849 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.950812    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fvqk\" (UniqueName: \"kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk\") pod \"06093d82-9c2d-46b3-a08e-59481a9487a4\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") "
Sep 17 14:24:04.951023 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.950856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume\") pod \"06093d82-9c2d-46b3-a08e-59481a9487a4\" (UID: \"06093d82-9c2d-46b3-a08e-59481a9487a4\") "
Sep 17 14:24:04.951263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.951238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06093d82-9c2d-46b3-a08e-59481a9487a4" (UID: "06093d82-9c2d-46b3-a08e-59481a9487a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:24:04.953376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:04.953346    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk" (OuterVolumeSpecName: "kube-api-access-7fvqk") pod "06093d82-9c2d-46b3-a08e-59481a9487a4" (UID: "06093d82-9c2d-46b3-a08e-59481a9487a4"). InnerVolumeSpecName "kube-api-access-7fvqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:05.051607 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.051573    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fvqk\" (UniqueName: \"kubernetes.io/projected/06093d82-9c2d-46b3-a08e-59481a9487a4-kube-api-access-7fvqk\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:24:05.051607 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.051607    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06093d82-9c2d-46b3-a08e-59481a9487a4-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:24:05.628645 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.628612    2560 generic.go:356] "Generic (PLEG): container finished" podID="06093d82-9c2d-46b3-a08e-59481a9487a4" containerID="7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808" exitCode=0
Sep 17 14:24:05.629049 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.628660    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"
Sep 17 14:24:05.629049 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.628696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" event={"ID":"06093d82-9c2d-46b3-a08e-59481a9487a4","Type":"ContainerDied","Data":"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"}
Sep 17 14:24:05.629049 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.628750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh" event={"ID":"06093d82-9c2d-46b3-a08e-59481a9487a4","Type":"ContainerDied","Data":"069fbd117c8780e698667339cbb714fdce9dd643f1c5a1545e136cd5326a360f"}
Sep 17 14:24:05.629049 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.628773    2560 scope.go:117] "RemoveContainer" containerID="7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"
Sep 17 14:24:05.638011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.637992    2560 scope.go:117] "RemoveContainer" containerID="7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"
Sep 17 14:24:05.638323 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:24:05.638297    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808\": container with ID starting with 7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808 not found: ID does not exist" containerID="7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"
Sep 17 14:24:05.638376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.638329    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808"} err="failed to get container status \"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808\": rpc error: code = NotFound desc = could not find container \"7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808\": container with ID starting with 7302b30ad9466f133b28eac0cfc9214b5d6cf16728f993f7371575a438632808 not found: ID does not exist"
Sep 17 14:24:05.652604 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.652571    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:24:05.655711 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:05.655675    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh"]
Sep 17 14:24:06.789256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:06.789216    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06093d82-9c2d-46b3-a08e-59481a9487a4" path="/var/lib/kubelet/pods/06093d82-9c2d-46b3-a08e-59481a9487a4/volumes"
Sep 17 14:24:10.788397 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:10.788362    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:24:11.211643 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.211615    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:24:11.212003 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.211991    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" containerName="payload-pre-processing"
Sep 17 14:24:11.212053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212005    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" containerName="payload-pre-processing"
Sep 17 14:24:11.212053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212031    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52910e29-4cd6-42c5-b685-1f9c652275c7" containerName="payload-processing"
Sep 17 14:24:11.212053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212037    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="52910e29-4cd6-42c5-b685-1f9c652275c7" containerName="payload-processing"
Sep 17 14:24:11.212053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212046    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06093d82-9c2d-46b3-a08e-59481a9487a4" containerName="payload-pre-processing"
Sep 17 14:24:11.212053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212052    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="06093d82-9c2d-46b3-a08e-59481a9487a4" containerName="payload-pre-processing"
Sep 17 14:24:11.212216 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212122    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="756f4bb8-5ea7-41a2-be88-7edd0c8957ab" containerName="payload-pre-processing"
Sep 17 14:24:11.212216 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212130    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="52910e29-4cd6-42c5-b685-1f9c652275c7" containerName="payload-processing"
Sep 17 14:24:11.212216 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.212138    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="06093d82-9c2d-46b3-a08e-59481a9487a4" containerName="payload-pre-processing"
Sep 17 14:24:11.216895 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.216873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.219594 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.219576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c98839-openshift-default-dockercfg-dzt56\""
Sep 17 14:24:11.231205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.231176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:24:11.306884 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.306833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.306929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307163 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307379 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307439 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.307500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.307469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkjf6\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408601 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408796 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.408965 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkjf6\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.408984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.409138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.409483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409508 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.409502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.409582    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.409696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.409601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.411053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.411031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.411455 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.411438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.416920 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.416898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.417286 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.417261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkjf6\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6\") pod \"e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") " pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.528068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.527967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:11.816696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.816664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:24:11.817818 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:24:11.817792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf72f9a4_92b8_482b_a7ea_b303406c01ea.slice/crio-7fde0b282968c9b1bd454c96bcb860b6a92321266405e087d54897af573a868d WatchSource:0}: Error finding container 7fde0b282968c9b1bd454c96bcb860b6a92321266405e087d54897af573a868d: Status 404 returned error can't find the container with id 7fde0b282968c9b1bd454c96bcb860b6a92321266405e087d54897af573a868d
Sep 17 14:24:11.820032 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.819995    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:11.820126 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.820063    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:11.820126 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:11.820093    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:12.669205 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:12.669168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerStarted","Data":"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"}
Sep 17 14:24:12.669417 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:12.669223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerStarted","Data":"7fde0b282968c9b1bd454c96bcb860b6a92321266405e087d54897af573a868d"}
Sep 17 14:24:12.691912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:12.691855    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podStartSLOduration=1.691838448 podStartE2EDuration="1.691838448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:12.689541448 +0000 UTC m=+1148.398414264" watchObservedRunningTime="2026-09-17 14:24:12.691838448 +0000 UTC m=+1148.400711264"
Sep 17 14:24:13.528263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:13.528226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:13.533961 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:13.533937    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:13.675415 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:13.675377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:13.676296 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:13.676272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:35.806320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.806284    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerID="e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d" exitCode=0
Sep 17 14:24:35.806790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.806346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerDied","Data":"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"}
Sep 17 14:24:35.806790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.806761    2560 scope.go:117] "RemoveContainer" containerID="e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"
Sep 17 14:24:35.807971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.807938    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:35.808035 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.808014    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:35.808072 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:35.808050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 14:24:36.814325 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:36.814285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerStarted","Data":"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"}
Sep 17 14:24:37.528139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:37.528097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:37.528336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:37.528318    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 14:24:37.528395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:37.528377    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 14:24:38.529054 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:38.529014    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 14:24:38.529470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:38.529073    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 14:24:39.529369 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:39.529327    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 14:24:39.529797 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:39.529400    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 14:24:40.090360 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:40.090317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:24:40.529240 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:40.529199    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 14:24:40.529433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:40.529271    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 14:24:41.529252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:41.529211    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 14:24:41.529458 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:41.529276    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 14:24:42.572966 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:42.572928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:42.573923 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:42.573893    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:42.575045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:42.575012    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:24:52.005488 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.005328    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:24:52.011335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.011276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.015971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.015936    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b83f70-serving-cert\""
Sep 17 14:24:52.020438 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.020399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:24:52.106263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.104908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.106263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.104971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.106263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.105070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jmbk\" (UniqueName: \"kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.106263 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.105123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.205998 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.205940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jmbk\" (UniqueName: \"kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.206226 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.206029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.206226 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.206082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.206226 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.206120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.206361 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:24:52.206267    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-serving-cert: secret "maas-api-e2e-shared-b-w2-b83f70-serving-cert" not found
Sep 17 14:24:52.206361 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:24:52.206353    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls podName:4d0f3b42-d815-416f-b97b-4d5d15c29907 nodeName:}" failed. No retries permitted until 2026-09-17 14:24:52.706330971 +0000 UTC m=+1188.415203779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls") pod "maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" (UID: "4d0f3b42-d815-416f-b97b-4d5d15c29907") : secret "maas-api-e2e-shared-b-w2-b83f70-serving-cert" not found
Sep 17 14:24:52.206911 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.206886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.209150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.209116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.217344 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.217297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jmbk\" (UniqueName: \"kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.710098 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.710043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.713010 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.712970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:52.749908 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.749864    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:24:52.752730 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.752702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.755560 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.755519    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-b83f70\""
Sep 17 14:24:52.755756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.755520    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-b83f70-dockercfg-fq7vx\""
Sep 17 14:24:52.764973 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.764932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:24:52.811204 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.811153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.811795 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.811318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkzv\" (UniqueName: \"kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.912928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.912882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.913151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.912954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkzv\" (UniqueName: \"kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.913749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.913722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.922651 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.922616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkzv\" (UniqueName: \"kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv\") pod \"payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:52.928335 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:52.928295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:53.066639 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.066590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:53.211460 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.211415    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:24:53.213096 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:24:53.213066    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0f3b42_d815_416f_b97b_4d5d15c29907.slice/crio-09ff0d945c8d3db6599020ac7aeffcbc56010e631973b15d519e9c5a8c45ffd3 WatchSource:0}: Error finding container 09ff0d945c8d3db6599020ac7aeffcbc56010e631973b15d519e9c5a8c45ffd3: Status 404 returned error can't find the container with id 09ff0d945c8d3db6599020ac7aeffcbc56010e631973b15d519e9c5a8c45ffd3
Sep 17 14:24:53.214468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.214445    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:24:53.344192 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.344163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:24:53.346018 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:24:53.345987    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1a4d58_be07_458c_a1ce_d1a79e2b438f.slice/crio-6f2a8d61c1e7302e77b2ee58473abe2203a091b4716f989d889f95c265a09804 WatchSource:0}: Error finding container 6f2a8d61c1e7302e77b2ee58473abe2203a091b4716f989d889f95c265a09804: Status 404 returned error can't find the container with id 6f2a8d61c1e7302e77b2ee58473abe2203a091b4716f989d889f95c265a09804
Sep 17 14:24:53.919360 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.919324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" event={"ID":"fc1a4d58-be07-458c-a1ce-d1a79e2b438f","Type":"ContainerStarted","Data":"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"}
Sep 17 14:24:53.919595 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.919390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" event={"ID":"fc1a4d58-be07-458c-a1ce-d1a79e2b438f","Type":"ContainerStarted","Data":"6f2a8d61c1e7302e77b2ee58473abe2203a091b4716f989d889f95c265a09804"}
Sep 17 14:24:53.919595 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.919535    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:24:53.921470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.921434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" event={"ID":"4d0f3b42-d815-416f-b97b-4d5d15c29907","Type":"ContainerStarted","Data":"09ff0d945c8d3db6599020ac7aeffcbc56010e631973b15d519e9c5a8c45ffd3"}
Sep 17 14:24:53.939060 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:53.938985    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" podStartSLOduration=1.938958363 podStartE2EDuration="1.938958363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:53.936912827 +0000 UTC m=+1189.645785644" watchObservedRunningTime="2026-09-17 14:24:53.938958363 +0000 UTC m=+1189.647831180"
Sep 17 14:24:54.929240 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:54.929197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" event={"ID":"4d0f3b42-d815-416f-b97b-4d5d15c29907","Type":"ContainerStarted","Data":"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"}
Sep 17 14:24:54.929767 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:54.929295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:24:54.949697 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:54.949626    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" podStartSLOduration=3.3235696040000002 podStartE2EDuration="3.949604867s" totalImagesPullingTime="626.035263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:54.94776509 +0000 UTC m=+1190.656637918" watchObservedRunningTime="2026-09-17 14:24:54.949604867 +0000 UTC m=+1190.658477685"
Sep 17 14:24:59.308991 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:24:59.308939    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:25:00.940974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:00.940941    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:25:04.931777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:04.931736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:25:36.600572 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.596588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:25:36.721235 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.721182    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:25:36.723930 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.723897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.729570 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.729527    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1a095586\""
Sep 17 14:25:36.729756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.729593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1a095586-dockercfg-jxzkp\""
Sep 17 14:25:36.739089 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.739046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:25:36.848360 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.848315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwlh\" (UniqueName: \"kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.848615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.848518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.949624 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.949541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwlh\" (UniqueName: \"kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.949808 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.949703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.950386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.950364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:36.959048 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:36.959015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwlh\" (UniqueName: \"kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh\") pod \"payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:37.038034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:37.037985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:37.318626 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:37.318592    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:25:37.320016 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:25:37.319977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f06b97e_ca80_450b_97c3_9d8f6e3ea581.slice/crio-18fde45392141fb80ee1b3852b85c14f6f6feab9cea344c38ec38d9515d788d4 WatchSource:0}: Error finding container 18fde45392141fb80ee1b3852b85c14f6f6feab9cea344c38ec38d9515d788d4: Status 404 returned error can't find the container with id 18fde45392141fb80ee1b3852b85c14f6f6feab9cea344c38ec38d9515d788d4
Sep 17 14:25:38.189649 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:38.189605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" event={"ID":"0f06b97e-ca80-450b-97c3-9d8f6e3ea581","Type":"ContainerStarted","Data":"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"}
Sep 17 14:25:38.190077 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:38.189677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:25:38.190077 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:38.189693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" event={"ID":"0f06b97e-ca80-450b-97c3-9d8f6e3ea581","Type":"ContainerStarted","Data":"18fde45392141fb80ee1b3852b85c14f6f6feab9cea344c38ec38d9515d788d4"}
Sep 17 14:25:38.207537 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:38.207472    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" podStartSLOduration=2.207447648 podStartE2EDuration="2.207447648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:25:38.207082442 +0000 UTC m=+1233.915955259" watchObservedRunningTime="2026-09-17 14:25:38.207447648 +0000 UTC m=+1233.916320465"
Sep 17 14:25:49.197433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:25:49.197399    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:26:03.145297 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:03.145201    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:26:13.887118 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:13.887072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:26:18.165258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.165215    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" podUID="2e98df20-30d0-4e83-a59a-08a3bc14533f" containerName="main" containerID="cri-o://9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7" gracePeriod=45
Sep 17 14:26:18.426529 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.426457    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:26:18.434017 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.433982    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e98df20-30d0-4e83-a59a-08a3bc14533f" containerID="9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7" exitCode=0
Sep 17 14:26:18.434200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.434029    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"
Sep 17 14:26:18.434200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.434068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" event={"ID":"2e98df20-30d0-4e83-a59a-08a3bc14533f","Type":"ContainerDied","Data":"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"}
Sep 17 14:26:18.434200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.434127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn" event={"ID":"2e98df20-30d0-4e83-a59a-08a3bc14533f","Type":"ContainerDied","Data":"045a7a0f7f7dc08f556c375eef7f358c18029acd5fd07ec12af63671c6e6e059"}
Sep 17 14:26:18.434200 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.434149    2560 scope.go:117] "RemoveContainer" containerID="9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"
Sep 17 14:26:18.444045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.444020    2560 scope.go:117] "RemoveContainer" containerID="9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"
Sep 17 14:26:18.444423 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:26:18.444401    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7\": container with ID starting with 9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7 not found: ID does not exist" containerID="9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"
Sep 17 14:26:18.444481 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.444437    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7"} err="failed to get container status \"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7\": rpc error: code = NotFound desc = could not find container \"9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7\": container with ID starting with 9f36f235200fa6f4915e22629b84c24c456c53d93d35d9df041e16561e8109a7 not found: ID does not exist"
Sep 17 14:26:18.549272 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549232    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549332    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsj7w\" (UniqueName: \"kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549421    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir\") pod \"2e98df20-30d0-4e83-a59a-08a3bc14533f\" (UID: \"2e98df20-30d0-4e83-a59a-08a3bc14533f\") "
Sep 17 14:26:18.549816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:26:18.549816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home" (OuterVolumeSpecName: "home") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:26:18.549816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549747    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-model-cache\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.549816 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.549805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:26:18.551730 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.551694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm" (OuterVolumeSpecName: "dshm") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:26:18.551859 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.551762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:18.551859 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.551787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w" (OuterVolumeSpecName: "kube-api-access-jsj7w") pod "2e98df20-30d0-4e83-a59a-08a3bc14533f" (UID: "2e98df20-30d0-4e83-a59a-08a3bc14533f"). InnerVolumeSpecName "kube-api-access-jsj7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:18.651016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.650971    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-dshm\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.651016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.651007    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e98df20-30d0-4e83-a59a-08a3bc14533f-tls-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.651016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.651020    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-home\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.651016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.651029    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsj7w\" (UniqueName: \"kubernetes.io/projected/2e98df20-30d0-4e83-a59a-08a3bc14533f-kube-api-access-jsj7w\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.651305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.651039    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e98df20-30d0-4e83-a59a-08a3bc14533f-tmp-dir\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:18.758577 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.758518    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:26:18.761000 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.760973    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-181b16/test-model-181b16-kserve-59ccb6d7d7-8pwqn"]
Sep 17 14:26:18.790003 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:18.789960    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e98df20-30d0-4e83-a59a-08a3bc14533f" path="/var/lib/kubelet/pods/2e98df20-30d0-4e83-a59a-08a3bc14533f/volumes"
Sep 17 14:26:50.093983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:50.093928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:26:58.515946 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.515896    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:26:58.516571 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.516170    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" podUID="e7aa7734-66bf-4748-bba1-cb2c98460a94" containerName="maas-api" containerID="cri-o://97de80c04ba1d5caaf97e508e61f21bb48199b27eca149cbacf0240f4c563de7" gracePeriod=30
Sep 17 14:26:58.584951 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.584910    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:26:58.585168 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.585141    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" podUID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" containerName="payload-processing" containerID="cri-o://593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e" gracePeriod=30
Sep 17 14:26:58.590777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.590739    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:26:58.591321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.591231    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" podUID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" containerName="payload-pre-processing" containerID="cri-o://107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc" gracePeriod=30
Sep 17 14:26:58.685192 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.685157    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7aa7734-66bf-4748-bba1-cb2c98460a94" containerID="97de80c04ba1d5caaf97e508e61f21bb48199b27eca149cbacf0240f4c563de7" exitCode=0
Sep 17 14:26:58.685373 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.685219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" event={"ID":"e7aa7734-66bf-4748-bba1-cb2c98460a94","Type":"ContainerDied","Data":"97de80c04ba1d5caaf97e508e61f21bb48199b27eca149cbacf0240f4c563de7"}
Sep 17 14:26:58.894759 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.894725    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:26:58.898532 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.898496    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:26:58.907812 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:58.907774    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:26:59.020884 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.020838    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume\") pod \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") "
Sep 17 14:26:59.020884 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.020886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdr8x\" (UniqueName: \"kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x\") pod \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\" (UID: \"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.020927    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs\") pod \"e7aa7734-66bf-4748-bba1-cb2c98460a94\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.020987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn7mn\" (UniqueName: \"kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn\") pod \"e7aa7734-66bf-4748-bba1-cb2c98460a94\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.021019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsjqp\" (UniqueName: \"kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp\") pod \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.021038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls\") pod \"e7aa7734-66bf-4748-bba1-cb2c98460a94\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.021054    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume\") pod \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\" (UID: \"00282529-ac54-4c4b-8b2c-6eb1ec00ea73\") "
Sep 17 14:26:59.021157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.021074    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca\") pod \"e7aa7734-66bf-4748-bba1-cb2c98460a94\" (UID: \"e7aa7734-66bf-4748-bba1-cb2c98460a94\") "
Sep 17 14:26:59.021972 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.021936    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" (UID: "7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:59.022676 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.022635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7aa7734-66bf-4748-bba1-cb2c98460a94" (UID: "e7aa7734-66bf-4748-bba1-cb2c98460a94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:59.022818 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.022792    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00282529-ac54-4c4b-8b2c-6eb1ec00ea73" (UID: "00282529-ac54-4c4b-8b2c-6eb1ec00ea73"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:26:59.023913 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.023870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp" (OuterVolumeSpecName: "kube-api-access-dsjqp") pod "00282529-ac54-4c4b-8b2c-6eb1ec00ea73" (UID: "00282529-ac54-4c4b-8b2c-6eb1ec00ea73"). InnerVolumeSpecName "kube-api-access-dsjqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:59.024186 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.024142    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x" (OuterVolumeSpecName: "kube-api-access-xdr8x") pod "7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" (UID: "7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb"). InnerVolumeSpecName "kube-api-access-xdr8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:59.025898 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.025857    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7aa7734-66bf-4748-bba1-cb2c98460a94" (UID: "e7aa7734-66bf-4748-bba1-cb2c98460a94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:59.031162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.031120    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7aa7734-66bf-4748-bba1-cb2c98460a94" (UID: "e7aa7734-66bf-4748-bba1-cb2c98460a94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:26:59.031162 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.031134    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn" (OuterVolumeSpecName: "kube-api-access-xn7mn") pod "e7aa7734-66bf-4748-bba1-cb2c98460a94" (UID: "e7aa7734-66bf-4748-bba1-cb2c98460a94"). InnerVolumeSpecName "kube-api-access-xn7mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:26:59.123139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123016    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn7mn\" (UniqueName: \"kubernetes.io/projected/e7aa7734-66bf-4748-bba1-cb2c98460a94-kube-api-access-xn7mn\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123065    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsjqp\" (UniqueName: \"kubernetes.io/projected/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-kube-api-access-dsjqp\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123111    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123124    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00282529-ac54-4c4b-8b2c-6eb1ec00ea73-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123139 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123139    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7aa7734-66bf-4748-bba1-cb2c98460a94-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123460 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123166    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123460 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123179    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdr8x\" (UniqueName: \"kubernetes.io/projected/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb-kube-api-access-xdr8x\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.123460 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.123190    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7aa7734-66bf-4748-bba1-cb2c98460a94-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:26:59.692616 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.692579    2560 generic.go:356] "Generic (PLEG): container finished" podID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" containerID="107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc" exitCode=0
Sep 17 14:26:59.693094 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.692646    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"
Sep 17 14:26:59.693094 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.692666    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" event={"ID":"00282529-ac54-4c4b-8b2c-6eb1ec00ea73","Type":"ContainerDied","Data":"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"}
Sep 17 14:26:59.693094 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.692753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j" event={"ID":"00282529-ac54-4c4b-8b2c-6eb1ec00ea73","Type":"ContainerDied","Data":"a7ccb8554fa0759c10309760ee4bcb34e71badaea2318a4029e41a20b83ff4b8"}
Sep 17 14:26:59.693094 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.692779    2560 scope.go:117] "RemoveContainer" containerID="107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"
Sep 17 14:26:59.694367 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.694278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95" event={"ID":"e7aa7734-66bf-4748-bba1-cb2c98460a94","Type":"ContainerDied","Data":"519ac7b3b84553bff0819bed479d2c5a26efe9cf54757627d7960c9d4cdf3c78"}
Sep 17 14:26:59.694367 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.694311    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"
Sep 17 14:26:59.696065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.696033    2560 generic.go:356] "Generic (PLEG): container finished" podID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" containerID="593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e" exitCode=0
Sep 17 14:26:59.696218 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.696087    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"
Sep 17 14:26:59.696218 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.696071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" event={"ID":"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb","Type":"ContainerDied","Data":"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"}
Sep 17 14:26:59.696218 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.696150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v" event={"ID":"7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb","Type":"ContainerDied","Data":"4e1e0364627ab4c92801e97cffba29f38695c0fa2d98203f2aa66a0850819540"}
Sep 17 14:26:59.705481 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.705388    2560 scope.go:117] "RemoveContainer" containerID="107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"
Sep 17 14:26:59.705850 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:26:59.705819    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc\": container with ID starting with 107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc not found: ID does not exist" containerID="107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"
Sep 17 14:26:59.705928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.705863    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc"} err="failed to get container status \"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc\": rpc error: code = NotFound desc = could not find container \"107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc\": container with ID starting with 107952eff702f47230a59ebaa0cb136e2eb86d708ec22a3da1473ffbc197cabc not found: ID does not exist"
Sep 17 14:26:59.705928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.705888    2560 scope.go:117] "RemoveContainer" containerID="97de80c04ba1d5caaf97e508e61f21bb48199b27eca149cbacf0240f4c563de7"
Sep 17 14:26:59.716328 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.716304    2560 scope.go:117] "RemoveContainer" containerID="593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"
Sep 17 14:26:59.721497 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.721459    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:26:59.726694 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.726663    2560 scope.go:117] "RemoveContainer" containerID="593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"
Sep 17 14:26:59.727078 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:26:59.727051    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e\": container with ID starting with 593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e not found: ID does not exist" containerID="593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"
Sep 17 14:26:59.727192 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.727083    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e"} err="failed to get container status \"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e\": rpc error: code = NotFound desc = could not find container \"593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e\": container with ID starting with 593eae0e771e7f6f17feed9dfc870ae4b02d25be2f85a56b3fcdd9c1d619122e not found: ID does not exist"
Sep 17 14:26:59.727475 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.727455    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j"]
Sep 17 14:26:59.739337 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.739300    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:26:59.743252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.743218    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9b8115-8b89cd974-vfk95"]
Sep 17 14:26:59.755252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.755215    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:26:59.759340 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:26:59.759304    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v"]
Sep 17 14:27:00.789638 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:00.789598    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" path="/var/lib/kubelet/pods/00282529-ac54-4c4b-8b2c-6eb1ec00ea73/volumes"
Sep 17 14:27:00.790052 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:00.790022    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" path="/var/lib/kubelet/pods/7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb/volumes"
Sep 17 14:27:00.790399 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:00.790384    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7aa7734-66bf-4748-bba1-cb2c98460a94" path="/var/lib/kubelet/pods/e7aa7734-66bf-4748-bba1-cb2c98460a94/volumes"
Sep 17 14:27:05.507978 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:05.507941    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:27:05.508477 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:05.508200    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy" containerID="cri-o://4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222" gracePeriod=30
Sep 17 14:27:10.758585 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.758541    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:27:10.769827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.769726    2560 generic.go:356] "Generic (PLEG): container finished" podID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerID="4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222" exitCode=0
Sep 17 14:27:10.769827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.769778    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"
Sep 17 14:27:10.769827 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.769786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerDied","Data":"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"}
Sep 17 14:27:10.770055 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.769838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw" event={"ID":"2a060f48-a702-4fd8-b946-08b55f1bbbc3","Type":"ContainerDied","Data":"2448a0ae154ec576b0b67686d0199b55f0b066b44c990a42ffe350dbd90ea59b"}
Sep 17 14:27:10.770055 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.769863    2560 scope.go:117] "RemoveContainer" containerID="4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"
Sep 17 14:27:10.780457 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.780430    2560 scope.go:117] "RemoveContainer" containerID="f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"
Sep 17 14:27:10.791638 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.791593    2560 scope.go:117] "RemoveContainer" containerID="4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"
Sep 17 14:27:10.792019 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:10.791992    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222\": container with ID starting with 4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222 not found: ID does not exist" containerID="4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"
Sep 17 14:27:10.792131 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.792027    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222"} err="failed to get container status \"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222\": rpc error: code = NotFound desc = could not find container \"4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222\": container with ID starting with 4b29129756b8a9594454b762ca2ae857451cd2109ace9937635fc99893ccb222 not found: ID does not exist"
Sep 17 14:27:10.792131 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.792045    2560 scope.go:117] "RemoveContainer" containerID="f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"
Sep 17 14:27:10.792382 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:10.792355    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd\": container with ID starting with f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd not found: ID does not exist" containerID="f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"
Sep 17 14:27:10.792437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.792395    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd"} err="failed to get container status \"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd\": rpc error: code = NotFound desc = could not find container \"f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd\": container with ID starting with f567438d39da739994321783c2b584e8dcce78bb301643cdc79da9b3929d06dd not found: ID does not exist"
Sep 17 14:27:10.943714 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943714 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7db2\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943907    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.943983 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.943981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.944292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs\") pod \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\" (UID: \"2a060f48-a702-4fd8-b946-08b55f1bbbc3\") "
Sep 17 14:27:10.944292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944118    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:27:10.944426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:27:10.944426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:27:10.944426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:27:10.944426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944419    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-credential-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.944685 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944460    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.944685 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944476    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-data\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.944685 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.944477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:27:10.946336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.946298    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:27:10.946468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.946395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2" (OuterVolumeSpecName: "kube-api-access-x7db2") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "kube-api-access-x7db2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:27:10.946652 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.946623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:27:10.946730 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:10.946629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a060f48-a702-4fd8-b946-08b55f1bbbc3" (UID: "2a060f48-a702-4fd8-b946-08b55f1bbbc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045628    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istiod-ca-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045666    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7db2\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-kube-api-access-x7db2\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045681    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045693    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-envoy\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045705    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a060f48-a702-4fd8-b946-08b55f1bbbc3-istio-podinfo\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.045741 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.045715    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a060f48-a702-4fd8-b946-08b55f1bbbc3-workload-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:11.093941 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.093898    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:27:11.098376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:11.098336    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw"]
Sep 17 14:27:12.789440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:12.789391    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" path="/var/lib/kubelet/pods/2a060f48-a702-4fd8-b946-08b55f1bbbc3/volumes"
Sep 17 14:27:13.397656 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.397610    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:27:13.398467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398438    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398467    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398484    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398493    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398517    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7aa7734-66bf-4748-bba1-cb2c98460a94" containerName="maas-api"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398526    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7aa7734-66bf-4748-bba1-cb2c98460a94" containerName="maas-api"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398558    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e98df20-30d0-4e83-a59a-08a3bc14533f" containerName="main"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398567    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e98df20-30d0-4e83-a59a-08a3bc14533f" containerName="main"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398576    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" containerName="payload-pre-processing"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398585    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" containerName="payload-pre-processing"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398595    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" containerName="payload-processing"
Sep 17 14:27:13.398660 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398605    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" containerName="payload-processing"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398700    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398711    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7383eba8-fef2-40b0-b7ed-eb5eeeedc9eb" containerName="payload-processing"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398720    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7aa7734-66bf-4748-bba1-cb2c98460a94" containerName="maas-api"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398733    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a060f48-a702-4fd8-b946-08b55f1bbbc3" containerName="istio-proxy"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398742    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00282529-ac54-4c4b-8b2c-6eb1ec00ea73" containerName="payload-pre-processing"
Sep 17 14:27:13.398971 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.398753    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e98df20-30d0-4e83-a59a-08a3bc14533f" containerName="main"
Sep 17 14:27:13.404164 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.404130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.407526 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.407485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-cc3801-serving-cert\""
Sep 17 14:27:13.418418 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.418385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:27:13.567290 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.567239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.567290 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.567298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.567582 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.567403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.567582 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.567446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvm7\" (UniqueName: \"kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.669017 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.668905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.669017 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.668967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.669017 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.669011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.669381 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.669034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvm7\" (UniqueName: \"kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.669381 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:13.669167    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-serving-cert: secret "maas-api-e2e-shared-a-w3-cc3801-serving-cert" not found
Sep 17 14:27:13.669381 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:13.669275    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls podName:59f4b89a-3f6b-411b-b971-b38d9173c911 nodeName:}" failed. No retries permitted until 2026-09-17 14:27:14.169249442 +0000 UTC m=+1329.878122237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls") pod "maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911") : secret "maas-api-e2e-shared-a-w3-cc3801-serving-cert" not found
Sep 17 14:27:13.669727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.669704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.671766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.671743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:13.681343 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:13.681305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvm7\" (UniqueName: \"kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:14.066776 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.066727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:27:14.070712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.070680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.073434 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.073397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-cc3801-dockercfg-q2zgt\""
Sep 17 14:27:14.073638 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.073397    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-cc3801\""
Sep 17 14:27:14.082329 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.082294    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:27:14.098226 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.098175    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:27:14.102399 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.102372    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.112912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.112880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:27:14.174937 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.174898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvx2\" (UniqueName: \"kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.175163 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.175011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.175332 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.175311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:14.175492 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:14.175472    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-serving-cert: secret "maas-api-e2e-shared-a-w3-cc3801-serving-cert" not found
Sep 17 14:27:14.175594 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:14.175577    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls podName:59f4b89a-3f6b-411b-b971-b38d9173c911 nodeName:}" failed. No retries permitted until 2026-09-17 14:27:15.175523865 +0000 UTC m=+1330.884396674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls") pod "maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911") : secret "maas-api-e2e-shared-a-w3-cc3801-serving-cert" not found
Sep 17 14:27:14.276310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.276255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvx2\" (UniqueName: \"kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.276310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.276312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.276587 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.276367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cr9\" (UniqueName: \"kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.276587 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.276421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.277141 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.277119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.285560 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.285527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvx2\" (UniqueName: \"kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2\") pod \"payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.377860 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.377751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cr9\" (UniqueName: \"kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.377860 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.377842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.378657 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.378634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.384922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.384888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.385938 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.385918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cr9\" (UniqueName: \"kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9\") pod \"payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.416266 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.416222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.668419 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.668385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:27:14.670030 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:14.670003    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13416bde_17b1_4d48_8366_e05e92c541c3.slice/crio-47bf49c70975be6b60b59c6f49a9ba0f0689624e0bb348214b86d193fedcebf4 WatchSource:0}: Error finding container 47bf49c70975be6b60b59c6f49a9ba0f0689624e0bb348214b86d193fedcebf4: Status 404 returned error can't find the container with id 47bf49c70975be6b60b59c6f49a9ba0f0689624e0bb348214b86d193fedcebf4
Sep 17 14:27:14.702534 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.702503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:27:14.704925 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:14.704894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea12093_5fe5_4e3b_9ce1_d035408d4f58.slice/crio-9a85ebe9829b7dac9fc82a470122e6f8d9fe4f2f451e8096110d98302ff103e1 WatchSource:0}: Error finding container 9a85ebe9829b7dac9fc82a470122e6f8d9fe4f2f451e8096110d98302ff103e1: Status 404 returned error can't find the container with id 9a85ebe9829b7dac9fc82a470122e6f8d9fe4f2f451e8096110d98302ff103e1
Sep 17 14:27:14.796913 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.796875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" event={"ID":"13416bde-17b1-4d48-8366-e05e92c541c3","Type":"ContainerStarted","Data":"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"}
Sep 17 14:27:14.797138 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.796951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:14.797138 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.796980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" event={"ID":"13416bde-17b1-4d48-8366-e05e92c541c3","Type":"ContainerStarted","Data":"47bf49c70975be6b60b59c6f49a9ba0f0689624e0bb348214b86d193fedcebf4"}
Sep 17 14:27:14.798784 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.798750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" event={"ID":"eea12093-5fe5-4e3b-9ce1-d035408d4f58","Type":"ContainerStarted","Data":"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"}
Sep 17 14:27:14.798921 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.798809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" event={"ID":"eea12093-5fe5-4e3b-9ce1-d035408d4f58","Type":"ContainerStarted","Data":"9a85ebe9829b7dac9fc82a470122e6f8d9fe4f2f451e8096110d98302ff103e1"}
Sep 17 14:27:14.798921 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.798838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:14.815241 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.815183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" podStartSLOduration=0.81516359 podStartE2EDuration="815.16359ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:14.813754024 +0000 UTC m=+1330.522626841" watchObservedRunningTime="2026-09-17 14:27:14.81516359 +0000 UTC m=+1330.524036430"
Sep 17 14:27:14.834615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:14.834535    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" podStartSLOduration=0.83451685 podStartE2EDuration="834.51685ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:14.832489787 +0000 UTC m=+1330.541362602" watchObservedRunningTime="2026-09-17 14:27:14.83451685 +0000 UTC m=+1330.543389665"
Sep 17 14:27:15.184387 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:15.184345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:15.187254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:15.187208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:15.218046 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:15.218003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:15.511022 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:15.510878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:27:15.513650 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:15.513617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f4b89a_3f6b_411b_b971_b38d9173c911.slice/crio-a747b9a25145d7dd8c298e386c294e91179ee4ddb8a7706f4464521844b7ddd1 WatchSource:0}: Error finding container a747b9a25145d7dd8c298e386c294e91179ee4ddb8a7706f4464521844b7ddd1: Status 404 returned error can't find the container with id a747b9a25145d7dd8c298e386c294e91179ee4ddb8a7706f4464521844b7ddd1
Sep 17 14:27:15.807030 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:15.806929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" event={"ID":"59f4b89a-3f6b-411b-b971-b38d9173c911","Type":"ContainerStarted","Data":"a747b9a25145d7dd8c298e386c294e91179ee4ddb8a7706f4464521844b7ddd1"}
Sep 17 14:27:16.815920 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:16.815875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" event={"ID":"59f4b89a-3f6b-411b-b971-b38d9173c911","Type":"ContainerStarted","Data":"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"}
Sep 17 14:27:16.816333 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:16.815968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:16.836137 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:16.836076    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" podStartSLOduration=3.349413544 podStartE2EDuration="3.836056225s" totalImagesPullingTime="486.642681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:16.835383975 +0000 UTC m=+1332.544256791" watchObservedRunningTime="2026-09-17 14:27:16.836056225 +0000 UTC m=+1332.544929063"
Sep 17 14:27:22.641691 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:22.641647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:27:22.827529 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:22.827497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:27:25.809786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:25.809751    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:27:25.810252 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:25.809918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:27:42.151793 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.151753    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:27:42.155510 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.155483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.157953 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.157929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-4c29a2-serving-cert\""
Sep 17 14:27:42.169901 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.169850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:27:42.248657 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.248608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.248858 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.248670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghxg2\" (UniqueName: \"kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.248858 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.248779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.248858 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.248826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.350434 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.350321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.350434 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.350394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghxg2\" (UniqueName: \"kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.350760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.350459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.350760 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.350497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.350760 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:42.350662    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-serving-cert: secret "maas-api-e2e-shared-b-w3-4c29a2-serving-cert" not found
Sep 17 14:27:42.350926 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:42.350763    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls podName:741b9150-7c8f-404b-a7b4-dd5a781a18ba nodeName:}" failed. No retries permitted until 2026-09-17 14:27:42.850738376 +0000 UTC m=+1358.559611193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls") pod "maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" (UID: "741b9150-7c8f-404b-a7b4-dd5a781a18ba") : secret "maas-api-e2e-shared-b-w3-4c29a2-serving-cert" not found
Sep 17 14:27:42.351206 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.351187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.353064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.353038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.359906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.359872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghxg2\" (UniqueName: \"kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.790751 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.790715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:27:42.794470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.794447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.797006 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.796983    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-4c29a2\""
Sep 17 14:27:42.797134 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.797059    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-4c29a2-dockercfg-v5pp9\""
Sep 17 14:27:42.805238 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.805205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:27:42.825257 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.825221    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:27:42.828677 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.828650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:42.840842 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.840805    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:27:42.855278 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.855241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6l5b\" (UniqueName: \"kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.855462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.855287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.855462 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.855317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.857942 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.857907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:42.956142 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.956103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8swz\" (UniqueName: \"kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:42.956142 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.956150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6l5b\" (UniqueName: \"kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.956386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.956181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.956386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.956217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:42.956923 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.956904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:42.964431 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:42.964392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6l5b\" (UniqueName: \"kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b\") pod \"payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:43.057040 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.056936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8swz\" (UniqueName: \"kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.057040 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.057014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.057736 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.057716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.065847 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.065822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8swz\" (UniqueName: \"kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz\") pod \"payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.073718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.073688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:43.108053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.108017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:43.141100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.140842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.356753 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.356721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:27:43.358760 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:43.358729    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741b9150_7c8f_404b_a7b4_dd5a781a18ba.slice/crio-f779bd213c9acf75d07c6fb1d9937a67133fc8f324f3158007549ac9404720f0 WatchSource:0}: Error finding container f779bd213c9acf75d07c6fb1d9937a67133fc8f324f3158007549ac9404720f0: Status 404 returned error can't find the container with id f779bd213c9acf75d07c6fb1d9937a67133fc8f324f3158007549ac9404720f0
Sep 17 14:27:43.401334 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.401305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:27:43.403260 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:43.403227    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc378a8d2_9768_4827_b02f_2b70622a0638.slice/crio-509e3540a0f06e5ab69a8ba79e3bf627abc63bfe1d5d6046a767fd99721f2222 WatchSource:0}: Error finding container 509e3540a0f06e5ab69a8ba79e3bf627abc63bfe1d5d6046a767fd99721f2222: Status 404 returned error can't find the container with id 509e3540a0f06e5ab69a8ba79e3bf627abc63bfe1d5d6046a767fd99721f2222
Sep 17 14:27:43.449051 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.449019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:27:43.450782 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:27:43.450751    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cb4e07_3b11_44b9_9302_43e0ad187a92.slice/crio-a1654c220cb410eafc3e2b87456aacf14e02a86cbd8329c54f2ac5419c6721c7 WatchSource:0}: Error finding container a1654c220cb410eafc3e2b87456aacf14e02a86cbd8329c54f2ac5419c6721c7: Status 404 returned error can't find the container with id a1654c220cb410eafc3e2b87456aacf14e02a86cbd8329c54f2ac5419c6721c7
Sep 17 14:27:43.986191 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.986135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" event={"ID":"c378a8d2-9768-4827-b02f-2b70622a0638","Type":"ContainerStarted","Data":"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"}
Sep 17 14:27:43.986386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.986365    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:27:43.986465 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.986404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" event={"ID":"c378a8d2-9768-4827-b02f-2b70622a0638","Type":"ContainerStarted","Data":"509e3540a0f06e5ab69a8ba79e3bf627abc63bfe1d5d6046a767fd99721f2222"}
Sep 17 14:27:43.988292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.988261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" event={"ID":"51cb4e07-3b11-44b9-9302-43e0ad187a92","Type":"ContainerStarted","Data":"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"}
Sep 17 14:27:43.988452 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.988322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" event={"ID":"51cb4e07-3b11-44b9-9302-43e0ad187a92","Type":"ContainerStarted","Data":"a1654c220cb410eafc3e2b87456aacf14e02a86cbd8329c54f2ac5419c6721c7"}
Sep 17 14:27:43.988519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.988444    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:43.990347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.990303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" event={"ID":"741b9150-7c8f-404b-a7b4-dd5a781a18ba","Type":"ContainerStarted","Data":"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"}
Sep 17 14:27:43.990500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.990359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" event={"ID":"741b9150-7c8f-404b-a7b4-dd5a781a18ba","Type":"ContainerStarted","Data":"f779bd213c9acf75d07c6fb1d9937a67133fc8f324f3158007549ac9404720f0"}
Sep 17 14:27:43.990500 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:43.990401    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:44.004809 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:44.004745    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" podStartSLOduration=2.004728024 podStartE2EDuration="2.004728024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:44.003357004 +0000 UTC m=+1359.712229834" watchObservedRunningTime="2026-09-17 14:27:44.004728024 +0000 UTC m=+1359.713600837"
Sep 17 14:27:44.027105 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:44.026989    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" podStartSLOduration=2.02696893 podStartE2EDuration="2.02696893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:44.024668327 +0000 UTC m=+1359.733541147" watchObservedRunningTime="2026-09-17 14:27:44.02696893 +0000 UTC m=+1359.735841791"
Sep 17 14:27:44.047763 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:44.047682    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" podStartSLOduration=1.635642323 podStartE2EDuration="2.047654987s" totalImagesPullingTime="412.012664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:44.047228934 +0000 UTC m=+1359.756101763" watchObservedRunningTime="2026-09-17 14:27:44.047654987 +0000 UTC m=+1359.756527803"
Sep 17 14:27:45.426987 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.426943    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:27:45.427482 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.427307    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" podUID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" containerName="payload-pre-processing" containerID="cri-o://130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c" gracePeriod=30
Sep 17 14:27:45.724468 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.723845    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:27:45.888325 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.888280    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wwlh\" (UniqueName: \"kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh\") pod \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") "
Sep 17 14:27:45.888561 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.888345    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume\") pod \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\" (UID: \"0f06b97e-ca80-450b-97c3-9d8f6e3ea581\") "
Sep 17 14:27:45.888880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.888845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f06b97e-ca80-450b-97c3-9d8f6e3ea581" (UID: "0f06b97e-ca80-450b-97c3-9d8f6e3ea581"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:27:45.891094 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.891066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh" (OuterVolumeSpecName: "kube-api-access-6wwlh") pod "0f06b97e-ca80-450b-97c3-9d8f6e3ea581" (UID: "0f06b97e-ca80-450b-97c3-9d8f6e3ea581"). InnerVolumeSpecName "kube-api-access-6wwlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:27:45.989786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.989681    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wwlh\" (UniqueName: \"kubernetes.io/projected/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-kube-api-access-6wwlh\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:45.989786 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:45.989717    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f06b97e-ca80-450b-97c3-9d8f6e3ea581-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:27:46.005334 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.005298    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" containerID="130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c" exitCode=0
Sep 17 14:27:46.005519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.005351    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"
Sep 17 14:27:46.005519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.005384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" event={"ID":"0f06b97e-ca80-450b-97c3-9d8f6e3ea581","Type":"ContainerDied","Data":"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"}
Sep 17 14:27:46.005519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.005443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6" event={"ID":"0f06b97e-ca80-450b-97c3-9d8f6e3ea581","Type":"ContainerDied","Data":"18fde45392141fb80ee1b3852b85c14f6f6feab9cea344c38ec38d9515d788d4"}
Sep 17 14:27:46.005519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.005474    2560 scope.go:117] "RemoveContainer" containerID="130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"
Sep 17 14:27:46.017358 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.017332    2560 scope.go:117] "RemoveContainer" containerID="130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"
Sep 17 14:27:46.017801 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:27:46.017772    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c\": container with ID starting with 130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c not found: ID does not exist" containerID="130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"
Sep 17 14:27:46.017883 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.017815    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c"} err="failed to get container status \"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c\": rpc error: code = NotFound desc = could not find container \"130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c\": container with ID starting with 130a460d57fc06c35c08e2c3ae0a48e5191b1f88caad69a33e0b4c0609fc939c not found: ID does not exist"
Sep 17 14:27:46.028449 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.028410    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:27:46.034376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.034338    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6"]
Sep 17 14:27:46.789324 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:46.789284    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" path="/var/lib/kubelet/pods/0f06b97e-ca80-450b-97c3-9d8f6e3ea581/volumes"
Sep 17 14:27:50.003780 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:50.003747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:27:54.999990 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:54.999953    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:27:55.000426 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:27:55.000042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:28:13.396208 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:28:13.396145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:28:46.896561 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:28:46.896506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:29:18.800892 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:18.800803    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:29:47.207315 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:47.207275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:29:55.641059 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.641022    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:29:55.641475 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.641462    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" containerName="payload-pre-processing"
Sep 17 14:29:55.641520 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.641476    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" containerName="payload-pre-processing"
Sep 17 14:29:55.641581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.641562    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f06b97e-ca80-450b-97c3-9d8f6e3ea581" containerName="payload-pre-processing"
Sep 17 14:29:55.644673 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.644656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.647497 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.647472    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a954c8\""
Sep 17 14:29:55.647616 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.647584    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a954c8-dockercfg-ltxww\""
Sep 17 14:29:55.656134 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.656105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:29:55.737169 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.737129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtkh\" (UniqueName: \"kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.737347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.737297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.838239 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.838200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.838419 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.838252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtkh\" (UniqueName: \"kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.838963 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.838940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.847440 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.847415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtkh\" (UniqueName: \"kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh\") pod \"payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") " pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:55.956118 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:55.956073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:56.229947 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:56.229916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:29:56.231127 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:29:56.231103    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e93f79_2d6f_45fa_a716_5ed207e20b1e.slice/crio-c66ea0853dececaa1b0d4147096d375e868ff904e7439da407e5d4e79c50a5c2 WatchSource:0}: Error finding container c66ea0853dececaa1b0d4147096d375e868ff904e7439da407e5d4e79c50a5c2: Status 404 returned error can't find the container with id c66ea0853dececaa1b0d4147096d375e868ff904e7439da407e5d4e79c50a5c2
Sep 17 14:29:56.776100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:56.776061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" event={"ID":"e5e93f79-2d6f-45fa-a716-5ed207e20b1e","Type":"ContainerStarted","Data":"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"}
Sep 17 14:29:56.776523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:56.776161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:29:56.776523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:56.776180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" event={"ID":"e5e93f79-2d6f-45fa-a716-5ed207e20b1e","Type":"ContainerStarted","Data":"c66ea0853dececaa1b0d4147096d375e868ff904e7439da407e5d4e79c50a5c2"}
Sep 17 14:29:56.819317 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:29:56.819263    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" podStartSLOduration=1.819248075 podStartE2EDuration="1.819248075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:56.81914397 +0000 UTC m=+1492.528016787" watchObservedRunningTime="2026-09-17 14:29:56.819248075 +0000 UTC m=+1492.528120890"
Sep 17 14:30:00.169993 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.169955    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"]
Sep 17 14:30:00.173569 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.173528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"
Sep 17 14:30:00.178127 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.178104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ddwrn\""
Sep 17 14:30:00.184264 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.184225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"]
Sep 17 14:30:00.185199 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.185178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"
Sep 17 14:30:00.469215 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.469185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"]
Sep 17 14:30:00.471261 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:30:00.471230    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823d2655_641a_4967_8b1a_98dda45e0bc1.slice/crio-559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644 WatchSource:0}: Error finding container 559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644: Status 404 returned error can't find the container with id 559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644
Sep 17 14:30:00.473896 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.473876    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:30:00.798777 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:00.798688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr" event={"ID":"823d2655-641a-4967-8b1a-98dda45e0bc1","Type":"ContainerStarted","Data":"559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644"}
Sep 17 14:30:04.822270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:04.822231    2560 generic.go:356] "Generic (PLEG): container finished" podID="823d2655-641a-4967-8b1a-98dda45e0bc1" containerID="20c4663bc8c5f05d51214fd34a69599847293af7a4b8b3832f64b4f5c11ce5df" exitCode=0
Sep 17 14:30:04.822678 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:04.822319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr" event={"ID":"823d2655-641a-4967-8b1a-98dda45e0bc1","Type":"ContainerDied","Data":"20c4663bc8c5f05d51214fd34a69599847293af7a4b8b3832f64b4f5c11ce5df"}
Sep 17 14:30:05.971773 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:05.971750    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"
Sep 17 14:30:06.837022 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:06.836997    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"
Sep 17 14:30:06.837230 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:06.836995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr" event={"ID":"823d2655-641a-4967-8b1a-98dda45e0bc1","Type":"ContainerDied","Data":"559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644"}
Sep 17 14:30:06.837230 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:06.837125    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="559e28be06b9b85b7949200e7bd9b6e666ebddfcbea10e660f9a3d436aad6644"
Sep 17 14:30:07.785186 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:07.785156    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:30:30.063166 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.063084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:30:30.830153 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.830116    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:30:30.830576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.830536    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823d2655-641a-4967-8b1a-98dda45e0bc1" containerName="cleanup"
Sep 17 14:30:30.830576 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.830563    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="823d2655-641a-4967-8b1a-98dda45e0bc1" containerName="cleanup"
Sep 17 14:30:30.830669 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.830637    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="823d2655-641a-4967-8b1a-98dda45e0bc1" containerName="cleanup"
Sep 17 14:30:30.832866 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.832848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.835577 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.835526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cf94fd-dockercfg-5fvdm\""
Sep 17 14:30:30.835577 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.835571    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cf94fd\""
Sep 17 14:30:30.840641 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.840609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.840762 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.840738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94jg\" (UniqueName: \"kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.848723 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.848699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:30:30.941485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.941448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.941705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.941503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94jg\" (UniqueName: \"kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.942493 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.942455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:30.953731 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:30.953701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94jg\" (UniqueName: \"kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg\") pod \"payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:31.143813 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:31.143717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:31.417146 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:31.417111    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:30:31.418376 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:30:31.418350    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12792c1e_3298_4a82_9194_f9b325561f60.slice/crio-e03feb2c0e4edbe6c48f19cf4b0a11b1603ca4c6bbdcaaf4b3a679ba44cfbfc2 WatchSource:0}: Error finding container e03feb2c0e4edbe6c48f19cf4b0a11b1603ca4c6bbdcaaf4b3a679ba44cfbfc2: Status 404 returned error can't find the container with id e03feb2c0e4edbe6c48f19cf4b0a11b1603ca4c6bbdcaaf4b3a679ba44cfbfc2
Sep 17 14:30:31.989069 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:31.989028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" event={"ID":"12792c1e-3298-4a82-9194-f9b325561f60","Type":"ContainerStarted","Data":"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"}
Sep 17 14:30:31.989292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:31.989091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" event={"ID":"12792c1e-3298-4a82-9194-f9b325561f60","Type":"ContainerStarted","Data":"e03feb2c0e4edbe6c48f19cf4b0a11b1603ca4c6bbdcaaf4b3a679ba44cfbfc2"}
Sep 17 14:30:31.989292 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:31.989219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:30:32.009872 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:32.009818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" podStartSLOduration=2.009798862 podStartE2EDuration="2.009798862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:30:32.007140653 +0000 UTC m=+1527.716013470" watchObservedRunningTime="2026-09-17 14:30:32.009798862 +0000 UTC m=+1527.718671678"
Sep 17 14:30:42.997171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:30:42.997135    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:31:08.493168 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:08.493129    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:31:13.662364 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:13.662311    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:31:13.663008 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:13.662626    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" podUID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" containerName="payload-processing" containerID="cri-o://c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38" gracePeriod=30
Sep 17 14:31:13.923282 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:13.923202    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:31:14.040115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.040077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume\") pod \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") "
Sep 17 14:31:14.040115 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.040119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjtkh\" (UniqueName: \"kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh\") pod \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\" (UID: \"e5e93f79-2d6f-45fa-a716-5ed207e20b1e\") "
Sep 17 14:31:14.040448 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.040425    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5e93f79-2d6f-45fa-a716-5ed207e20b1e" (UID: "e5e93f79-2d6f-45fa-a716-5ed207e20b1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:31:14.042230 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.042202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh" (OuterVolumeSpecName: "kube-api-access-wjtkh") pod "e5e93f79-2d6f-45fa-a716-5ed207e20b1e" (UID: "e5e93f79-2d6f-45fa-a716-5ed207e20b1e"). InnerVolumeSpecName "kube-api-access-wjtkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:31:14.140974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.140926    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:31:14.140974 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.140965    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjtkh\" (UniqueName: \"kubernetes.io/projected/e5e93f79-2d6f-45fa-a716-5ed207e20b1e-kube-api-access-wjtkh\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:31:14.239047 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.239010    2560 generic.go:356] "Generic (PLEG): container finished" podID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" containerID="c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38" exitCode=0
Sep 17 14:31:14.239274 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.239084    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"
Sep 17 14:31:14.239274 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.239096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" event={"ID":"e5e93f79-2d6f-45fa-a716-5ed207e20b1e","Type":"ContainerDied","Data":"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"}
Sep 17 14:31:14.239274 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.239152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg" event={"ID":"e5e93f79-2d6f-45fa-a716-5ed207e20b1e","Type":"ContainerDied","Data":"c66ea0853dececaa1b0d4147096d375e868ff904e7439da407e5d4e79c50a5c2"}
Sep 17 14:31:14.239274 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.239175    2560 scope.go:117] "RemoveContainer" containerID="c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"
Sep 17 14:31:14.248998 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.248955    2560 scope.go:117] "RemoveContainer" containerID="c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"
Sep 17 14:31:14.249418 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:31:14.249395    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38\": container with ID starting with c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38 not found: ID does not exist" containerID="c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"
Sep 17 14:31:14.249498 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.249431    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38"} err="failed to get container status \"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38\": rpc error: code = NotFound desc = could not find container \"c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38\": container with ID starting with c1e903b3d9ad459a1bd9be9e53679a4ee91ec081076b317fcc4fb1728c85fd38 not found: ID does not exist"
Sep 17 14:31:14.261642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.261602    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:31:14.265946 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.265913    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg"]
Sep 17 14:31:14.790165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:14.790124    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" path="/var/lib/kubelet/pods/e5e93f79-2d6f-45fa-a716-5ed207e20b1e/volumes"
Sep 17 14:31:36.735880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:36.735833    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:31:36.736850 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:36.736124    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" podUID="12792c1e-3298-4a82-9194-f9b325561f60" containerName="payload-processing" containerID="cri-o://3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0" gracePeriod=30
Sep 17 14:31:37.008061 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.008032    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:31:37.060157 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.060122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume\") pod \"12792c1e-3298-4a82-9194-f9b325561f60\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") "
Sep 17 14:31:37.060350 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.060273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p94jg\" (UniqueName: \"kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg\") pod \"12792c1e-3298-4a82-9194-f9b325561f60\" (UID: \"12792c1e-3298-4a82-9194-f9b325561f60\") "
Sep 17 14:31:37.060519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.060496    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12792c1e-3298-4a82-9194-f9b325561f60" (UID: "12792c1e-3298-4a82-9194-f9b325561f60"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:31:37.062485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.062451    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg" (OuterVolumeSpecName: "kube-api-access-p94jg") pod "12792c1e-3298-4a82-9194-f9b325561f60" (UID: "12792c1e-3298-4a82-9194-f9b325561f60"). InnerVolumeSpecName "kube-api-access-p94jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:31:37.161224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.161179    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p94jg\" (UniqueName: \"kubernetes.io/projected/12792c1e-3298-4a82-9194-f9b325561f60-kube-api-access-p94jg\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:31:37.161224 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.161219    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12792c1e-3298-4a82-9194-f9b325561f60-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:31:37.379743 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.379650    2560 generic.go:356] "Generic (PLEG): container finished" podID="12792c1e-3298-4a82-9194-f9b325561f60" containerID="3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0" exitCode=0
Sep 17 14:31:37.379743 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.379703    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"
Sep 17 14:31:37.379927 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.379740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" event={"ID":"12792c1e-3298-4a82-9194-f9b325561f60","Type":"ContainerDied","Data":"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"}
Sep 17 14:31:37.379927 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.379800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47" event={"ID":"12792c1e-3298-4a82-9194-f9b325561f60","Type":"ContainerDied","Data":"e03feb2c0e4edbe6c48f19cf4b0a11b1603ca4c6bbdcaaf4b3a679ba44cfbfc2"}
Sep 17 14:31:37.379927 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.379831    2560 scope.go:117] "RemoveContainer" containerID="3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"
Sep 17 14:31:37.389762 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.389739    2560 scope.go:117] "RemoveContainer" containerID="3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"
Sep 17 14:31:37.390133 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:31:37.390110    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0\": container with ID starting with 3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0 not found: ID does not exist" containerID="3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"
Sep 17 14:31:37.390209 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.390146    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0"} err="failed to get container status \"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0\": rpc error: code = NotFound desc = could not find container \"3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0\": container with ID starting with 3cd4ec48b776dce5f2597470b26716e5148924dc8bda2ce15400c09ab33c8da0 not found: ID does not exist"
Sep 17 14:31:37.419073 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.419037    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:31:37.431696 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:37.431658    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47"]
Sep 17 14:31:38.789525 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:38.789480    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12792c1e-3298-4a82-9194-f9b325561f60" path="/var/lib/kubelet/pods/12792c1e-3298-4a82-9194-f9b325561f60/volumes"
Sep 17 14:31:49.989124 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:31:49.989089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:32:01.878893 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:01.878806    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:32:01.879322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:01.879047    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy" containerID="cri-o://532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d" gracePeriod=30
Sep 17 14:32:07.139502 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.139471    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:32:07.242385 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242385 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242385    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242688 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242688 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242688 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242688 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242652    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242757    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:32:07.242906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.242906 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242862    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:32:07.243102 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242870    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkjf6\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6\") pod \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\" (UID: \"bf72f9a4-92b8-482b-a7ea-b303406c01ea\") "
Sep 17 14:32:07.243102 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.242938    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:07.243206 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:32:07.243267 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243246    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.243321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243267    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istiod-ca-cert\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.243321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243280    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-credential-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.243321 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243293    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-workload-socket\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.243483 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.243349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:32:07.244810 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.244784    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:32:07.244917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.244807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6" (OuterVolumeSpecName: "kube-api-access-mkjf6") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "kube-api-access-mkjf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:07.244917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.244786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:32:07.244917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.244884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf72f9a4-92b8-482b-a7ea-b303406c01ea" (UID: "bf72f9a4-92b8-482b-a7ea-b303406c01ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:07.344327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.344289    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-token\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.344327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.344321    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkjf6\" (UniqueName: \"kubernetes.io/projected/bf72f9a4-92b8-482b-a7ea-b303406c01ea-kube-api-access-mkjf6\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.344327 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.344335    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-envoy\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.344617 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.344347    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-podinfo\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.344617 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.344358    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf72f9a4-92b8-482b-a7ea-b303406c01ea-istio-data\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:07.566100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.566000    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerID="532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d" exitCode=0
Sep 17 14:32:07.566100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.566058    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"
Sep 17 14:32:07.566293 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.566093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerDied","Data":"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"}
Sep 17 14:32:07.566293 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.566149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x" event={"ID":"bf72f9a4-92b8-482b-a7ea-b303406c01ea","Type":"ContainerDied","Data":"7fde0b282968c9b1bd454c96bcb860b6a92321266405e087d54897af573a868d"}
Sep 17 14:32:07.566293 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.566174    2560 scope.go:117] "RemoveContainer" containerID="532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"
Sep 17 14:32:07.576575 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.576534    2560 scope.go:117] "RemoveContainer" containerID="e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"
Sep 17 14:32:07.586885 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.586859    2560 scope.go:117] "RemoveContainer" containerID="532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"
Sep 17 14:32:07.587257 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:32:07.587236    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d\": container with ID starting with 532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d not found: ID does not exist" containerID="532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"
Sep 17 14:32:07.587336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.587270    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d"} err="failed to get container status \"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d\": rpc error: code = NotFound desc = could not find container \"532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d\": container with ID starting with 532b235e7b947581ce886cfbbf7b9fd25437b81155865b5448621566d1679a1d not found: ID does not exist"
Sep 17 14:32:07.587336 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.587297    2560 scope.go:117] "RemoveContainer" containerID="e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"
Sep 17 14:32:07.587647 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:32:07.587627    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d\": container with ID starting with e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d not found: ID does not exist" containerID="e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"
Sep 17 14:32:07.587687 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.587653    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d"} err="failed to get container status \"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d\": rpc error: code = NotFound desc = could not find container \"e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d\": container with ID starting with e56c14163f725760a4b20f9844a2c68a8202266caf6ccfd9a2bfd4420ffa7c7d not found: ID does not exist"
Sep 17 14:32:07.592467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.592421    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:32:07.597667 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:07.597630    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x"]
Sep 17 14:32:08.789734 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:08.789698    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" path="/var/lib/kubelet/pods/bf72f9a4-92b8-482b-a7ea-b303406c01ea/volumes"
Sep 17 14:32:12.859108 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:12.859070    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:32:12.859609 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:12.859305    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" podUID="4d0f3b42-d815-416f-b97b-4d5d15c29907" containerName="maas-api" containerID="cri-o://1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45" gracePeriod=30
Sep 17 14:32:12.924434 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:12.924392    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:32:12.924748 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:12.924720    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" podUID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" containerName="payload-processing" containerID="cri-o://f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4" gracePeriod=30
Sep 17 14:32:13.175523 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.175493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:32:13.198712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.197754    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca\") pod \"4d0f3b42-d815-416f-b97b-4d5d15c29907\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") "
Sep 17 14:32:13.198712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.197803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") pod \"4d0f3b42-d815-416f-b97b-4d5d15c29907\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") "
Sep 17 14:32:13.198712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.197948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jmbk\" (UniqueName: \"kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk\") pod \"4d0f3b42-d815-416f-b97b-4d5d15c29907\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") "
Sep 17 14:32:13.198712 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.197984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs\") pod \"4d0f3b42-d815-416f-b97b-4d5d15c29907\" (UID: \"4d0f3b42-d815-416f-b97b-4d5d15c29907\") "
Sep 17 14:32:13.207145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.202942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d0f3b42-d815-416f-b97b-4d5d15c29907" (UID: "4d0f3b42-d815-416f-b97b-4d5d15c29907"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:13.207145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.204471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4d0f3b42-d815-416f-b97b-4d5d15c29907" (UID: "4d0f3b42-d815-416f-b97b-4d5d15c29907"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:32:13.207145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.206183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk" (OuterVolumeSpecName: "kube-api-access-4jmbk") pod "4d0f3b42-d815-416f-b97b-4d5d15c29907" (UID: "4d0f3b42-d815-416f-b97b-4d5d15c29907"). InnerVolumeSpecName "kube-api-access-4jmbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:13.207145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.206506    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d0f3b42-d815-416f-b97b-4d5d15c29907" (UID: "4d0f3b42-d815-416f-b97b-4d5d15c29907"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:32:13.215406 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.215375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:32:13.298718 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.298671    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvkzv\" (UniqueName: \"kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv\") pod \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") "
Sep 17 14:32:13.298928 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.298776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume\") pod \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\" (UID: \"fc1a4d58-be07-458c-a1ce-d1a79e2b438f\") "
Sep 17 14:32:13.299067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.299001    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jmbk\" (UniqueName: \"kubernetes.io/projected/4d0f3b42-d815-416f-b97b-4d5d15c29907-kube-api-access-4jmbk\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.299067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.299024    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.299067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.299038    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0f3b42-d815-416f-b97b-4d5d15c29907-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.299067 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.299051    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d0f3b42-d815-416f-b97b-4d5d15c29907-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.299212 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.299162    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc1a4d58-be07-458c-a1ce-d1a79e2b438f" (UID: "fc1a4d58-be07-458c-a1ce-d1a79e2b438f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:32:13.300900 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.300874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv" (OuterVolumeSpecName: "kube-api-access-zvkzv") pod "fc1a4d58-be07-458c-a1ce-d1a79e2b438f" (UID: "fc1a4d58-be07-458c-a1ce-d1a79e2b438f"). InnerVolumeSpecName "kube-api-access-zvkzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:32:13.400581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.400441    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvkzv\" (UniqueName: \"kubernetes.io/projected/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-kube-api-access-zvkzv\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.400581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.400477    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1a4d58-be07-458c-a1ce-d1a79e2b438f-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:32:13.605111 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.605073    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" containerID="f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4" exitCode=0
Sep 17 14:32:13.605320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.605125    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"
Sep 17 14:32:13.605320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.605163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" event={"ID":"fc1a4d58-be07-458c-a1ce-d1a79e2b438f","Type":"ContainerDied","Data":"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"}
Sep 17 14:32:13.605320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.605224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m" event={"ID":"fc1a4d58-be07-458c-a1ce-d1a79e2b438f","Type":"ContainerDied","Data":"6f2a8d61c1e7302e77b2ee58473abe2203a091b4716f989d889f95c265a09804"}
Sep 17 14:32:13.605320 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.605259    2560 scope.go:117] "RemoveContainer" containerID="f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"
Sep 17 14:32:13.606664 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.606640    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d0f3b42-d815-416f-b97b-4d5d15c29907" containerID="1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45" exitCode=0
Sep 17 14:32:13.606788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.606677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" event={"ID":"4d0f3b42-d815-416f-b97b-4d5d15c29907","Type":"ContainerDied","Data":"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"}
Sep 17 14:32:13.606788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.606693    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"
Sep 17 14:32:13.606788 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.606730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw" event={"ID":"4d0f3b42-d815-416f-b97b-4d5d15c29907","Type":"ContainerDied","Data":"09ff0d945c8d3db6599020ac7aeffcbc56010e631973b15d519e9c5a8c45ffd3"}
Sep 17 14:32:13.616254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.616228    2560 scope.go:117] "RemoveContainer" containerID="f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"
Sep 17 14:32:13.616594 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:32:13.616572    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4\": container with ID starting with f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4 not found: ID does not exist" containerID="f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"
Sep 17 14:32:13.616665 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.616604    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4"} err="failed to get container status \"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4\": rpc error: code = NotFound desc = could not find container \"f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4\": container with ID starting with f487c34a51d4f7208e2a2e8c124caa95b96e0bd40f5a858c8236fad821e027c4 not found: ID does not exist"
Sep 17 14:32:13.616665 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.616625    2560 scope.go:117] "RemoveContainer" containerID="1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"
Sep 17 14:32:13.625520 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.625456    2560 scope.go:117] "RemoveContainer" containerID="1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"
Sep 17 14:32:13.626384 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:32:13.626362    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45\": container with ID starting with 1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45 not found: ID does not exist" containerID="1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"
Sep 17 14:32:13.626488 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.626393    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45"} err="failed to get container status \"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45\": rpc error: code = NotFound desc = could not find container \"1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45\": container with ID starting with 1dca6cedc20dbd206c895c74cfa8745713d8f6c8ed5c7c38b5a5d38636c28c45 not found: ID does not exist"
Sep 17 14:32:13.628711 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.628689    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:32:13.632459 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.632428    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m"]
Sep 17 14:32:13.643880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.643834    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:32:13.648149 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:13.648114    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b83f70-866cfc6d8-k87rw"]
Sep 17 14:32:14.790607 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:14.790569    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0f3b42-d815-416f-b97b-4d5d15c29907" path="/var/lib/kubelet/pods/4d0f3b42-d815-416f-b97b-4d5d15c29907/volumes"
Sep 17 14:32:14.791011 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:14.790953    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" path="/var/lib/kubelet/pods/fc1a4d58-be07-458c-a1ce-d1a79e2b438f/volumes"
Sep 17 14:32:29.494758 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:29.494711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:32:51.795130 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:32:51.795089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:33:02.426993 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:02.426948    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:33:13.330121 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.330078    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:33:13.330615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.330285    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" podUID="f613931b-5fb1-4792-af0b-05ab02972c56" containerName="maas-api" containerID="cri-o://fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531" gracePeriod=30
Sep 17 14:33:13.375362 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.375319    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:33:13.375691 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.375635    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" podUID="dec99946-acd6-4b66-8479-634e2b5d8cee" containerName="payload-processing" containerID="cri-o://ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083" gracePeriod=30
Sep 17 14:33:13.627189 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.627154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:33:13.670823 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.670793    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:33:13.765879 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.765836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca\") pod \"f613931b-5fb1-4792-af0b-05ab02972c56\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") "
Sep 17 14:33:13.765879 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.765884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume\") pod \"dec99946-acd6-4b66-8479-634e2b5d8cee\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") "
Sep 17 14:33:13.766150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.765928    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z27vn\" (UniqueName: \"kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn\") pod \"f613931b-5fb1-4792-af0b-05ab02972c56\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") "
Sep 17 14:33:13.766150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766066    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls\") pod \"f613931b-5fb1-4792-af0b-05ab02972c56\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") "
Sep 17 14:33:13.766150 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5dxv\" (UniqueName: \"kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv\") pod \"dec99946-acd6-4b66-8479-634e2b5d8cee\" (UID: \"dec99946-acd6-4b66-8479-634e2b5d8cee\") "
Sep 17 14:33:13.766310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766177    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs\") pod \"f613931b-5fb1-4792-af0b-05ab02972c56\" (UID: \"f613931b-5fb1-4792-af0b-05ab02972c56\") "
Sep 17 14:33:13.766310 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766291    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f613931b-5fb1-4792-af0b-05ab02972c56" (UID: "f613931b-5fb1-4792-af0b-05ab02972c56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:13.766394 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766332    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dec99946-acd6-4b66-8479-634e2b5d8cee" (UID: "dec99946-acd6-4b66-8479-634e2b5d8cee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:33:13.766506 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766491    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f613931b-5fb1-4792-af0b-05ab02972c56-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.766581 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.766508    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dec99946-acd6-4b66-8479-634e2b5d8cee-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.768122 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.768084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f613931b-5fb1-4792-af0b-05ab02972c56" (UID: "f613931b-5fb1-4792-af0b-05ab02972c56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:33:13.768257 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.768236    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn" (OuterVolumeSpecName: "kube-api-access-z27vn") pod "f613931b-5fb1-4792-af0b-05ab02972c56" (UID: "f613931b-5fb1-4792-af0b-05ab02972c56"). InnerVolumeSpecName "kube-api-access-z27vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:13.768304 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.768255    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f613931b-5fb1-4792-af0b-05ab02972c56" (UID: "f613931b-5fb1-4792-af0b-05ab02972c56"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:33:13.768493 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.768460    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv" (OuterVolumeSpecName: "kube-api-access-v5dxv") pod "dec99946-acd6-4b66-8479-634e2b5d8cee" (UID: "dec99946-acd6-4b66-8479-634e2b5d8cee"). InnerVolumeSpecName "kube-api-access-v5dxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:13.867386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.867262    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z27vn\" (UniqueName: \"kubernetes.io/projected/f613931b-5fb1-4792-af0b-05ab02972c56-kube-api-access-z27vn\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.867386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.867321    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.867386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.867336    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5dxv\" (UniqueName: \"kubernetes.io/projected/dec99946-acd6-4b66-8479-634e2b5d8cee-kube-api-access-v5dxv\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.867386 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.867349    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f613931b-5fb1-4792-af0b-05ab02972c56-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:13.956690 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.956651    2560 generic.go:356] "Generic (PLEG): container finished" podID="dec99946-acd6-4b66-8479-634e2b5d8cee" containerID="ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083" exitCode=0
Sep 17 14:33:13.956888 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.956703    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"
Sep 17 14:33:13.956888 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.956737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" event={"ID":"dec99946-acd6-4b66-8479-634e2b5d8cee","Type":"ContainerDied","Data":"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"}
Sep 17 14:33:13.956888 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.956796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p" event={"ID":"dec99946-acd6-4b66-8479-634e2b5d8cee","Type":"ContainerDied","Data":"62e33b70c2261b0b9d9f4125782f1013a9af64b6336098a54618c0964eb1d62a"}
Sep 17 14:33:13.956888 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.956822    2560 scope.go:117] "RemoveContainer" containerID="ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"
Sep 17 14:33:13.958245 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.958222    2560 generic.go:356] "Generic (PLEG): container finished" podID="f613931b-5fb1-4792-af0b-05ab02972c56" containerID="fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531" exitCode=0
Sep 17 14:33:13.958357 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.958285    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"
Sep 17 14:33:13.958357 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.958298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" event={"ID":"f613931b-5fb1-4792-af0b-05ab02972c56","Type":"ContainerDied","Data":"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"}
Sep 17 14:33:13.958357 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.958340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4" event={"ID":"f613931b-5fb1-4792-af0b-05ab02972c56","Type":"ContainerDied","Data":"47b234a3f04bcf773a5b858175dfc58314489b110ecc81b4e1ff082d9e8b7c07"}
Sep 17 14:33:13.967831 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.967806    2560 scope.go:117] "RemoveContainer" containerID="ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"
Sep 17 14:33:13.968220 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:33:13.968193    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083\": container with ID starting with ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083 not found: ID does not exist" containerID="ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"
Sep 17 14:33:13.968303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.968228    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083"} err="failed to get container status \"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083\": rpc error: code = NotFound desc = could not find container \"ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083\": container with ID starting with ea4c8a66b45cf873864c710e156cdb38cd94b4e07bfcdb7533cbd69aedbb5083 not found: ID does not exist"
Sep 17 14:33:13.968303 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.968256    2560 scope.go:117] "RemoveContainer" containerID="fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"
Sep 17 14:33:13.978260 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.978234    2560 scope.go:117] "RemoveContainer" containerID="fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"
Sep 17 14:33:13.978644 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:33:13.978623    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531\": container with ID starting with fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531 not found: ID does not exist" containerID="fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"
Sep 17 14:33:13.978722 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.978651    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531"} err="failed to get container status \"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531\": rpc error: code = NotFound desc = could not find container \"fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531\": container with ID starting with fbc6e775c5a37ed6689a9a579011793d6104dcd535f2c604ae5a31e4a8a38531 not found: ID does not exist"
Sep 17 14:33:13.984270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.984234    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:33:13.989905 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:13.989863    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-fcd9f3-68d6dc7487-kdkr4"]
Sep 17 14:33:14.001914 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:14.001874    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:33:14.006427 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:14.006381    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p"]
Sep 17 14:33:14.790766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:14.790732    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec99946-acd6-4b66-8479-634e2b5d8cee" path="/var/lib/kubelet/pods/dec99946-acd6-4b66-8479-634e2b5d8cee/volumes"
Sep 17 14:33:14.791193 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:14.791153    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f613931b-5fb1-4792-af0b-05ab02972c56" path="/var/lib/kubelet/pods/f613931b-5fb1-4792-af0b-05ab02972c56/volumes"
Sep 17 14:33:16.289470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:16.289431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:33:17.448245 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.448183    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" podUID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" containerName="main" containerID="cri-o://dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42" gracePeriod=45
Sep 17 14:33:17.693102 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.693073    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:33:17.804961 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.804858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.804961 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.804915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82wlm\" (UniqueName: \"kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.805197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.804985    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.805197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.805197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805070    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.805197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir\") pod \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\" (UID: \"0292f6dc-8ac7-45c7-92f7-fdf671ae3214\") "
Sep 17 14:33:17.805197 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home" (OuterVolumeSpecName: "home") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:33:17.805441 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache" (OuterVolumeSpecName: "model-cache") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:33:17.805441 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805416    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-model-cache\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.805441 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805435    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-home\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.805574 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.805475    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:33:17.807373 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.807348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm" (OuterVolumeSpecName: "dshm") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:33:17.807479 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.807453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm" (OuterVolumeSpecName: "kube-api-access-82wlm") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "kube-api-access-82wlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:33:17.807479 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.807455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0292f6dc-8ac7-45c7-92f7-fdf671ae3214" (UID: "0292f6dc-8ac7-45c7-92f7-fdf671ae3214"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:33:17.906053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.906008    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tls-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.906053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.906045    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-tmp-dir\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.906053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.906055    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82wlm\" (UniqueName: \"kubernetes.io/projected/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-kube-api-access-82wlm\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.906053 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.906065    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0292f6dc-8ac7-45c7-92f7-fdf671ae3214-dshm\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:33:17.987087 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.987044    2560 generic.go:356] "Generic (PLEG): container finished" podID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" containerID="dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42" exitCode=0
Sep 17 14:33:17.987087 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.987093    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"
Sep 17 14:33:17.987305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.987103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" event={"ID":"0292f6dc-8ac7-45c7-92f7-fdf671ae3214","Type":"ContainerDied","Data":"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"}
Sep 17 14:33:17.987305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.987144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp" event={"ID":"0292f6dc-8ac7-45c7-92f7-fdf671ae3214","Type":"ContainerDied","Data":"3cb58c7989a5b9e68f4ec5188170ba7cb196eb661548afe9fe485cbbfa61f945"}
Sep 17 14:33:17.987305 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.987162    2560 scope.go:117] "RemoveContainer" containerID="dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"
Sep 17 14:33:17.996988 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.996966    2560 scope.go:117] "RemoveContainer" containerID="dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"
Sep 17 14:33:17.997344 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:33:17.997323    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42\": container with ID starting with dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42 not found: ID does not exist" containerID="dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"
Sep 17 14:33:17.997393 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:17.997357    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42"} err="failed to get container status \"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42\": rpc error: code = NotFound desc = could not find container \"dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42\": container with ID starting with dd6afed789f77028154274bc5ebf809958abe6d1291574d91b7e75223b0a3e42 not found: ID does not exist"
Sep 17 14:33:18.008529 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:18.008488    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:33:18.011757 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:18.011726    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-fcd9f3/premium-w4-fcd9f3-kserve-6bd8f59549-t46jp"]
Sep 17 14:33:18.790193 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:18.790154    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" path="/var/lib/kubelet/pods/0292f6dc-8ac7-45c7-92f7-fdf671ae3214/volumes"
Sep 17 14:33:30.489679 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:30.489568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:33:42.590734 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:42.590687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:33:57.688207 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:33:57.688164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:35:01.565096 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:35:01.564541    2560 controller.go:195] "Failed to update lease" err="Put \"https://a2b89f3df576c40229a4e99950687ee2-0e02d3b4ed87b95e.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-184.ec2.internal?timeout=10s\": read tcp 10.0.136.184:49322->54.83.162.120:6443: read: connection reset by peer"
Sep 17 14:36:43.392653 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.392604    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-184.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-6f4d9a9c-b466-48fc-bb29-13cef4544b0c.svc:9743/node?timeout=10s\": dial tcp 172.30.162.63:9743: connect: connection refused"
Sep 17 14:36:43.411986 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.411933    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-184.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-6f4d9a9c-b466-48fc-bb29-13cef4544b0c.svc:9743/node?timeout=10s\": dial tcp 172.30.162.63:9743: connect: connection refused"
Sep 17 14:36:43.426659 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.426612    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-184.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-6f4d9a9c-b466-48fc-bb29-13cef4544b0c.svc:9743/node?timeout=10s\": dial tcp 172.30.162.63:9743: connect: connection refused"
Sep 17 14:36:43.439965 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.439915    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-184.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-6f4d9a9c-b466-48fc-bb29-13cef4544b0c.svc:9743/node?timeout=10s\": dial tcp 172.30.162.63:9743: connect: connection refused"
Sep 17 14:36:43.454377 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.454328    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-17T14:36:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-184.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-6f4d9a9c-b466-48fc-bb29-13cef4544b0c.svc:9743/node?timeout=10s\": dial tcp 172.30.162.63:9743: connect: connection refused"
Sep 17 14:36:43.454377 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:36:43.454378    2560 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Sep 17 14:37:08.292090 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:37:08.292049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:42:50.994626 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:50.994589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:42:50.995182 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:50.994819    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" podUID="59f4b89a-3f6b-411b-b971-b38d9173c911" containerName="maas-api" containerID="cri-o://23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b" gracePeriod=30
Sep 17 14:42:51.104868 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.104835    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:42:51.105519 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.105063    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" podUID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" containerName="payload-processing" containerID="cri-o://8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02" gracePeriod=30
Sep 17 14:42:51.113862 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.113829    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:42:51.115074 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.114126    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" podUID="13416bde-17b1-4d48-8366-e05e92c541c3" containerName="payload-pre-processing" containerID="cri-o://fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364" gracePeriod=30
Sep 17 14:42:51.281910 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.281883    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:42:51.373854 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.373822    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:42:51.383166 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.383138    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:42:51.401568 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.401519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cvm7\" (UniqueName: \"kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7\") pod \"59f4b89a-3f6b-411b-b971-b38d9173c911\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") "
Sep 17 14:42:51.401768 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.401613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca\") pod \"59f4b89a-3f6b-411b-b971-b38d9173c911\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") "
Sep 17 14:42:51.401768 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.401662    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs\") pod \"59f4b89a-3f6b-411b-b971-b38d9173c911\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") "
Sep 17 14:42:51.401768 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.401691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") pod \"59f4b89a-3f6b-411b-b971-b38d9173c911\" (UID: \"59f4b89a-3f6b-411b-b971-b38d9173c911\") "
Sep 17 14:42:51.402474 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.402438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59f4b89a-3f6b-411b-b971-b38d9173c911" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:42:51.404032 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.404002    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59f4b89a-3f6b-411b-b971-b38d9173c911" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:42:51.404130 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.404048    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7" (OuterVolumeSpecName: "kube-api-access-8cvm7") pod "59f4b89a-3f6b-411b-b971-b38d9173c911" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911"). InnerVolumeSpecName "kube-api-access-8cvm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:42:51.404437 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.404395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59f4b89a-3f6b-411b-b971-b38d9173c911" (UID: "59f4b89a-3f6b-411b-b971-b38d9173c911"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:42:51.502615 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.502537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume\") pod \"13416bde-17b1-4d48-8366-e05e92c541c3\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") "
Sep 17 14:42:51.502820 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.502643    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume\") pod \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") "
Sep 17 14:42:51.502820 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.502742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvx2\" (UniqueName: \"kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2\") pod \"13416bde-17b1-4d48-8366-e05e92c541c3\" (UID: \"13416bde-17b1-4d48-8366-e05e92c541c3\") "
Sep 17 14:42:51.502820 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.502784    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6cr9\" (UniqueName: \"kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9\") pod \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\" (UID: \"eea12093-5fe5-4e3b-9ce1-d035408d4f58\") "
Sep 17 14:42:51.503010 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.502995    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b89a-3f6b-411b-b971-b38d9173c911-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.503065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.503011    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.503065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.503022    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b89a-3f6b-411b-b971-b38d9173c911-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.503065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.503034    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cvm7\" (UniqueName: \"kubernetes.io/projected/59f4b89a-3f6b-411b-b971-b38d9173c911-kube-api-access-8cvm7\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.503065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.503029    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eea12093-5fe5-4e3b-9ce1-d035408d4f58" (UID: "eea12093-5fe5-4e3b-9ce1-d035408d4f58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:42:51.503065 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.503031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13416bde-17b1-4d48-8366-e05e92c541c3" (UID: "13416bde-17b1-4d48-8366-e05e92c541c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:42:51.504922 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.504898    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2" (OuterVolumeSpecName: "kube-api-access-kxvx2") pod "13416bde-17b1-4d48-8366-e05e92c541c3" (UID: "13416bde-17b1-4d48-8366-e05e92c541c3"). InnerVolumeSpecName "kube-api-access-kxvx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:42:51.505021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.504923    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9" (OuterVolumeSpecName: "kube-api-access-k6cr9") pod "eea12093-5fe5-4e3b-9ce1-d035408d4f58" (UID: "eea12093-5fe5-4e3b-9ce1-d035408d4f58"). InnerVolumeSpecName "kube-api-access-k6cr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:42:51.603485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.603387    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13416bde-17b1-4d48-8366-e05e92c541c3-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.603485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.603424    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eea12093-5fe5-4e3b-9ce1-d035408d4f58-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.603485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.603433    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvx2\" (UniqueName: \"kubernetes.io/projected/13416bde-17b1-4d48-8366-e05e92c541c3-kube-api-access-kxvx2\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:51.603485 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:51.603443    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6cr9\" (UniqueName: \"kubernetes.io/projected/eea12093-5fe5-4e3b-9ce1-d035408d4f58-kube-api-access-k6cr9\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.103179 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.103143    2560 generic.go:356] "Generic (PLEG): container finished" podID="59f4b89a-3f6b-411b-b971-b38d9173c911" containerID="23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b" exitCode=0
Sep 17 14:42:52.103642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.103189    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"
Sep 17 14:42:52.103642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.103222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" event={"ID":"59f4b89a-3f6b-411b-b971-b38d9173c911","Type":"ContainerDied","Data":"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"}
Sep 17 14:42:52.103642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.103279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh" event={"ID":"59f4b89a-3f6b-411b-b971-b38d9173c911","Type":"ContainerDied","Data":"a747b9a25145d7dd8c298e386c294e91179ee4ddb8a7706f4464521844b7ddd1"}
Sep 17 14:42:52.103642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.103304    2560 scope.go:117] "RemoveContainer" containerID="23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"
Sep 17 14:42:52.104799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.104720    2560 generic.go:356] "Generic (PLEG): container finished" podID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" containerID="8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02" exitCode=0
Sep 17 14:42:52.104799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.104748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" event={"ID":"eea12093-5fe5-4e3b-9ce1-d035408d4f58","Type":"ContainerDied","Data":"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"}
Sep 17 14:42:52.104799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.104763    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"
Sep 17 14:42:52.104799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.104793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs" event={"ID":"eea12093-5fe5-4e3b-9ce1-d035408d4f58","Type":"ContainerDied","Data":"9a85ebe9829b7dac9fc82a470122e6f8d9fe4f2f451e8096110d98302ff103e1"}
Sep 17 14:42:52.106249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.106228    2560 generic.go:356] "Generic (PLEG): container finished" podID="13416bde-17b1-4d48-8366-e05e92c541c3" containerID="fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364" exitCode=0
Sep 17 14:42:52.106347 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.106273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"
Sep 17 14:42:52.106431 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.106277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" event={"ID":"13416bde-17b1-4d48-8366-e05e92c541c3","Type":"ContainerDied","Data":"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"}
Sep 17 14:42:52.106431 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.106419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99" event={"ID":"13416bde-17b1-4d48-8366-e05e92c541c3","Type":"ContainerDied","Data":"47bf49c70975be6b60b59c6f49a9ba0f0689624e0bb348214b86d193fedcebf4"}
Sep 17 14:42:52.115016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.114920    2560 scope.go:117] "RemoveContainer" containerID="23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"
Sep 17 14:42:52.115338 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:42:52.115310    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b\": container with ID starting with 23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b not found: ID does not exist" containerID="23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"
Sep 17 14:42:52.115443 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.115348    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b"} err="failed to get container status \"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b\": rpc error: code = NotFound desc = could not find container \"23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b\": container with ID starting with 23a03fb6bf5519b0ae88557d64d43e8cebaf499309beb017795dbe734beba40b not found: ID does not exist"
Sep 17 14:42:52.115443 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.115371    2560 scope.go:117] "RemoveContainer" containerID="8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"
Sep 17 14:42:52.124103 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.124084    2560 scope.go:117] "RemoveContainer" containerID="8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"
Sep 17 14:42:52.124413 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:42:52.124391    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02\": container with ID starting with 8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02 not found: ID does not exist" containerID="8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"
Sep 17 14:42:52.124489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.124425    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02"} err="failed to get container status \"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02\": rpc error: code = NotFound desc = could not find container \"8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02\": container with ID starting with 8ccca564eca23d50ba63019d55d96ba5c31b2572f0741378c5f7ba74cb6fed02 not found: ID does not exist"
Sep 17 14:42:52.124489 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.124448    2560 scope.go:117] "RemoveContainer" containerID="fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"
Sep 17 14:42:52.132907 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.132875    2560 scope.go:117] "RemoveContainer" containerID="fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"
Sep 17 14:42:52.133320 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:42:52.133297    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364\": container with ID starting with fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364 not found: ID does not exist" containerID="fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"
Sep 17 14:42:52.133395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.133330    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364"} err="failed to get container status \"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364\": rpc error: code = NotFound desc = could not find container \"fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364\": container with ID starting with fde85213cd6a375f4744d0b79b41829fcfcdd7eb24cd9bf862ba82236d49d364 not found: ID does not exist"
Sep 17 14:42:52.135359 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.135337    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:42:52.143201 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.143174    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-cc3801-6d9bfcdc94-j54jh"]
Sep 17 14:42:52.158190 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.158144    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:42:52.161507 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.161474    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99"]
Sep 17 14:42:52.176995 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.176951    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:42:52.180766 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.180729    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs"]
Sep 17 14:42:52.788976 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.788940    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13416bde-17b1-4d48-8366-e05e92c541c3" path="/var/lib/kubelet/pods/13416bde-17b1-4d48-8366-e05e92c541c3/volumes"
Sep 17 14:42:52.789328 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.789315    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f4b89a-3f6b-411b-b971-b38d9173c911" path="/var/lib/kubelet/pods/59f4b89a-3f6b-411b-b971-b38d9173c911/volumes"
Sep 17 14:42:52.789642 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:52.789630    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" path="/var/lib/kubelet/pods/eea12093-5fe5-4e3b-9ce1-d035408d4f58/volumes"
Sep 17 14:42:56.192811 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:42:56.192767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:43:50.751100 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.751062    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:43:50.751705 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.751298    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" podUID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" containerName="maas-api" containerID="cri-o://3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0" gracePeriod=30
Sep 17 14:43:50.788839 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.788797    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"]
Sep 17 14:43:50.788839 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.788839    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4c29a2-29827590-jkjfr"]
Sep 17 14:43:50.812254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.812210    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:43:50.812544 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.812486    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" podUID="51cb4e07-3b11-44b9-9302-43e0ad187a92" containerName="payload-processing" containerID="cri-o://44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4" gracePeriod=30
Sep 17 14:43:50.825781 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.825736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:43:50.826299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:50.826245    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" podUID="c378a8d2-9768-4827-b02f-2b70622a0638" containerName="payload-pre-processing" containerID="cri-o://b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f" gracePeriod=30
Sep 17 14:43:51.083637 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.083598    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:43:51.117086 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.117051    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:43:51.126761 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.126733    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:43:51.219122 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219083    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs\") pod \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") "
Sep 17 14:43:51.219343 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume\") pod \"51cb4e07-3b11-44b9-9302-43e0ad187a92\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") "
Sep 17 14:43:51.219343 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219182    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6l5b\" (UniqueName: \"kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b\") pod \"c378a8d2-9768-4827-b02f-2b70622a0638\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") "
Sep 17 14:43:51.219343 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219279    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume\") pod \"c378a8d2-9768-4827-b02f-2b70622a0638\" (UID: \"c378a8d2-9768-4827-b02f-2b70622a0638\") "
Sep 17 14:43:51.219517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219345    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghxg2\" (UniqueName: \"kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2\") pod \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") "
Sep 17 14:43:51.219517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca\") pod \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") "
Sep 17 14:43:51.219517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219403    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8swz\" (UniqueName: \"kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz\") pod \"51cb4e07-3b11-44b9-9302-43e0ad187a92\" (UID: \"51cb4e07-3b11-44b9-9302-43e0ad187a92\") "
Sep 17 14:43:51.219517 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") pod \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\" (UID: \"741b9150-7c8f-404b-a7b4-dd5a781a18ba\") "
Sep 17 14:43:51.219799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51cb4e07-3b11-44b9-9302-43e0ad187a92" (UID: "51cb4e07-3b11-44b9-9302-43e0ad187a92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:43:51.219799 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c378a8d2-9768-4827-b02f-2b70622a0638" (UID: "c378a8d2-9768-4827-b02f-2b70622a0638"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:43:51.219908 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219861    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c378a8d2-9768-4827-b02f-2b70622a0638-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.219908 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219880    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51cb4e07-3b11-44b9-9302-43e0ad187a92-plugins-config-volume\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.220009 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.219925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "741b9150-7c8f-404b-a7b4-dd5a781a18ba" (UID: "741b9150-7c8f-404b-a7b4-dd5a781a18ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:43:51.221483 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.221451    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "741b9150-7c8f-404b-a7b4-dd5a781a18ba" (UID: "741b9150-7c8f-404b-a7b4-dd5a781a18ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:43:51.221722 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.221703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz" (OuterVolumeSpecName: "kube-api-access-d8swz") pod "51cb4e07-3b11-44b9-9302-43e0ad187a92" (UID: "51cb4e07-3b11-44b9-9302-43e0ad187a92"). InnerVolumeSpecName "kube-api-access-d8swz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:43:51.221876 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.221837    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "741b9150-7c8f-404b-a7b4-dd5a781a18ba" (UID: "741b9150-7c8f-404b-a7b4-dd5a781a18ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:43:51.221966 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.221911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2" (OuterVolumeSpecName: "kube-api-access-ghxg2") pod "741b9150-7c8f-404b-a7b4-dd5a781a18ba" (UID: "741b9150-7c8f-404b-a7b4-dd5a781a18ba"). InnerVolumeSpecName "kube-api-access-ghxg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:43:51.221966 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.221916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b" (OuterVolumeSpecName: "kube-api-access-l6l5b") pod "c378a8d2-9768-4827-b02f-2b70622a0638" (UID: "c378a8d2-9768-4827-b02f-2b70622a0638"). InnerVolumeSpecName "kube-api-access-l6l5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321144    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8swz\" (UniqueName: \"kubernetes.io/projected/51cb4e07-3b11-44b9-9302-43e0ad187a92-kube-api-access-d8swz\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321190    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321200    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741b9150-7c8f-404b-a7b4-dd5a781a18ba-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321208    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6l5b\" (UniqueName: \"kubernetes.io/projected/c378a8d2-9768-4827-b02f-2b70622a0638-kube-api-access-l6l5b\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321218    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghxg2\" (UniqueName: \"kubernetes.io/projected/741b9150-7c8f-404b-a7b4-dd5a781a18ba-kube-api-access-ghxg2\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.321256 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.321227    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/741b9150-7c8f-404b-a7b4-dd5a781a18ba-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:43:51.427711 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.427674    2560 generic.go:356] "Generic (PLEG): container finished" podID="51cb4e07-3b11-44b9-9302-43e0ad187a92" containerID="44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4" exitCode=0
Sep 17 14:43:51.427917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.427736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"
Sep 17 14:43:51.427917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.427759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" event={"ID":"51cb4e07-3b11-44b9-9302-43e0ad187a92","Type":"ContainerDied","Data":"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"}
Sep 17 14:43:51.427917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.427851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v" event={"ID":"51cb4e07-3b11-44b9-9302-43e0ad187a92","Type":"ContainerDied","Data":"a1654c220cb410eafc3e2b87456aacf14e02a86cbd8329c54f2ac5419c6721c7"}
Sep 17 14:43:51.427917 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.427892    2560 scope.go:117] "RemoveContainer" containerID="44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"
Sep 17 14:43:51.429247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.429223    2560 generic.go:356] "Generic (PLEG): container finished" podID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" containerID="3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0" exitCode=0
Sep 17 14:43:51.429338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.429270    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"
Sep 17 14:43:51.429338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.429304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" event={"ID":"741b9150-7c8f-404b-a7b4-dd5a781a18ba","Type":"ContainerDied","Data":"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"}
Sep 17 14:43:51.429436 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.429365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7" event={"ID":"741b9150-7c8f-404b-a7b4-dd5a781a18ba","Type":"ContainerDied","Data":"f779bd213c9acf75d07c6fb1d9937a67133fc8f324f3158007549ac9404720f0"}
Sep 17 14:43:51.431076 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.431043    2560 generic.go:356] "Generic (PLEG): container finished" podID="c378a8d2-9768-4827-b02f-2b70622a0638" containerID="b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f" exitCode=0
Sep 17 14:43:51.431247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.431125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" event={"ID":"c378a8d2-9768-4827-b02f-2b70622a0638","Type":"ContainerDied","Data":"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"}
Sep 17 14:43:51.431247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.431153    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"
Sep 17 14:43:51.431247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.431171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d" event={"ID":"c378a8d2-9768-4827-b02f-2b70622a0638","Type":"ContainerDied","Data":"509e3540a0f06e5ab69a8ba79e3bf627abc63bfe1d5d6046a767fd99721f2222"}
Sep 17 14:43:51.437880 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.437858    2560 scope.go:117] "RemoveContainer" containerID="44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"
Sep 17 14:43:51.438283 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:43:51.438254    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4\": container with ID starting with 44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4 not found: ID does not exist" containerID="44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"
Sep 17 14:43:51.438370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.438297    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4"} err="failed to get container status \"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4\": rpc error: code = NotFound desc = could not find container \"44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4\": container with ID starting with 44258c27fcf7373ba519062bd073a3cc7335aa3223e97344c891ef14499c4be4 not found: ID does not exist"
Sep 17 14:43:51.438370 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.438324    2560 scope.go:117] "RemoveContainer" containerID="3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"
Sep 17 14:43:51.448701 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.448673    2560 scope.go:117] "RemoveContainer" containerID="3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"
Sep 17 14:43:51.449080 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:43:51.449059    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0\": container with ID starting with 3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0 not found: ID does not exist" containerID="3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"
Sep 17 14:43:51.449151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.449087    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0"} err="failed to get container status \"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0\": rpc error: code = NotFound desc = could not find container \"3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0\": container with ID starting with 3bd8c8407d705b5cef3a43e1a391dfe65b7138b87b511e529292474d031f87f0 not found: ID does not exist"
Sep 17 14:43:51.449151 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.449105    2560 scope.go:117] "RemoveContainer" containerID="b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"
Sep 17 14:43:51.456761 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.456726    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:43:51.458952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.458923    2560 scope.go:117] "RemoveContainer" containerID="b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"
Sep 17 14:43:51.459334 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:43:51.459311    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f\": container with ID starting with b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f not found: ID does not exist" containerID="b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"
Sep 17 14:43:51.459427 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.459343    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f"} err="failed to get container status \"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f\": rpc error: code = NotFound desc = could not find container \"b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f\": container with ID starting with b28a0e3fc40103329c193059fe46dc8b34a3060743081e82b9f4dff72e1e912f not found: ID does not exist"
Sep 17 14:43:51.460338 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.460315    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4c29a2-6556bcc58b-zv5j7"]
Sep 17 14:43:51.471933 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.471848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:43:51.475351 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.475317    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v"]
Sep 17 14:43:51.486333 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.486297    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:43:51.493117 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:51.493078    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d"]
Sep 17 14:43:52.788962 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:52.788929    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51cb4e07-3b11-44b9-9302-43e0ad187a92" path="/var/lib/kubelet/pods/51cb4e07-3b11-44b9-9302-43e0ad187a92/volumes"
Sep 17 14:43:52.789354 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:52.789305    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" path="/var/lib/kubelet/pods/741b9150-7c8f-404b-a7b4-dd5a781a18ba/volumes"
Sep 17 14:43:52.789535 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:52.789522    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823d2655-641a-4967-8b1a-98dda45e0bc1" path="/var/lib/kubelet/pods/823d2655-641a-4967-8b1a-98dda45e0bc1/volumes"
Sep 17 14:43:52.789844 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:52.789830    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c378a8d2-9768-4827-b02f-2b70622a0638" path="/var/lib/kubelet/pods/c378a8d2-9768-4827-b02f-2b70622a0638/volumes"
Sep 17 14:43:53.598542 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:43:53.598497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:44:05.092882 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:44:05.092799    2560 scope.go:117] "RemoveContainer" containerID="20c4663bc8c5f05d51214fd34a69599847293af7a4b8b3832f64b4f5c11ce5df"
Sep 17 14:44:05.188397 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:44:05.188352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:45:00.157063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157017    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"]
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157475    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157493    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157506    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec99946-acd6-4b66-8479-634e2b5d8cee" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157516    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec99946-acd6-4b66-8479-634e2b5d8cee" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51cb4e07-3b11-44b9-9302-43e0ad187a92" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157536    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="51cb4e07-3b11-44b9-9302-43e0ad187a92" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157572    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157585    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157594    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157605    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157613    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" containerName="payload-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157624    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f613931b-5fb1-4792-af0b-05ab02972c56" containerName="maas-api"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157632    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f613931b-5fb1-4792-af0b-05ab02972c56" containerName="maas-api"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157640    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13416bde-17b1-4d48-8366-e05e92c541c3" containerName="payload-pre-processing"
Sep 17 14:45:00.157647 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157647    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="13416bde-17b1-4d48-8366-e05e92c541c3" containerName="payload-pre-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157663    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c378a8d2-9768-4827-b02f-2b70622a0638" containerName="payload-pre-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157670    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c378a8d2-9768-4827-b02f-2b70622a0638" containerName="payload-pre-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157680    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157688    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" containerName="main"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157711    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" containerName="main"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157720    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0f3b42-d815-416f-b97b-4d5d15c29907" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157729    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0f3b42-d815-416f-b97b-4d5d15c29907" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157737    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12792c1e-3298-4a82-9194-f9b325561f60" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157746    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="12792c1e-3298-4a82-9194-f9b325561f60" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157756    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f4b89a-3f6b-411b-b971-b38d9173c911" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157764    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f4b89a-3f6b-411b-b971-b38d9173c911" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157844    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="13416bde-17b1-4d48-8366-e05e92c541c3" containerName="payload-pre-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157855    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157864    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="12792c1e-3298-4a82-9194-f9b325561f60" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157872    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157879    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec99946-acd6-4b66-8479-634e2b5d8cee" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157887    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c378a8d2-9768-4827-b02f-2b70622a0638" containerName="payload-pre-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157895    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0292f6dc-8ac7-45c7-92f7-fdf671ae3214" containerName="main"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157903    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f4b89a-3f6b-411b-b971-b38d9173c911" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157911    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f613931b-5fb1-4792-af0b-05ab02972c56" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157920    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0f3b42-d815-416f-b97b-4d5d15c29907" containerName="maas-api"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157926    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea12093-5fe5-4e3b-9ce1-d035408d4f58" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157934    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1a4d58-be07-458c-a1ce-d1a79e2b438f" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157942    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e93f79-2d6f-45fa-a716-5ed207e20b1e" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157952    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="51cb4e07-3b11-44b9-9302-43e0ad187a92" containerName="payload-processing"
Sep 17 14:45:00.158433 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.157959    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="741b9150-7c8f-404b-a7b4-dd5a781a18ba" containerName="maas-api"
Sep 17 14:45:00.161173 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.161152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"
Sep 17 14:45:00.167248 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.167219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"]
Sep 17 14:45:00.169016 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.168997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ddwrn\""
Sep 17 14:45:00.172515 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.172492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"
Sep 17 14:45:00.450217 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.450180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"]
Sep 17 14:45:00.451712 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:45:00.451677    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ec81c0_9b08_49cd_a5c1_40948ab4c79d.slice/crio-5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee WatchSource:0}: Error finding container 5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee: Status 404 returned error can't find the container with id 5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee
Sep 17 14:45:00.782072 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.782036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8" event={"ID":"74ec81c0-9b08-49cd-a5c1-40948ab4c79d","Type":"ContainerStarted","Data":"36fcaa5ceeb0a384ca37313088e8d3e921ed1a7a492c446dc0216b29983f324b"}
Sep 17 14:45:00.782254 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.782113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8" event={"ID":"74ec81c0-9b08-49cd-a5c1-40948ab4c79d","Type":"ContainerStarted","Data":"5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee"}
Sep 17 14:45:00.800343 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:00.800270    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8" podStartSLOduration=0.800254284 podStartE2EDuration="800.254284ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:45:00.798452051 +0000 UTC m=+2396.507324869" watchObservedRunningTime="2026-09-17 14:45:00.800254284 +0000 UTC m=+2396.509127098"
Sep 17 14:45:01.788089 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:01.788057    2560 generic.go:356] "Generic (PLEG): container finished" podID="74ec81c0-9b08-49cd-a5c1-40948ab4c79d" containerID="36fcaa5ceeb0a384ca37313088e8d3e921ed1a7a492c446dc0216b29983f324b" exitCode=0
Sep 17 14:45:01.788479 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:01.788148    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8" event={"ID":"74ec81c0-9b08-49cd-a5c1-40948ab4c79d","Type":"ContainerDied","Data":"36fcaa5ceeb0a384ca37313088e8d3e921ed1a7a492c446dc0216b29983f324b"}
Sep 17 14:45:02.913185 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:02.913157    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"
Sep 17 14:45:03.799064 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:03.799033    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8"
Sep 17 14:45:03.799219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:03.799039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29827605-78zr8" event={"ID":"74ec81c0-9b08-49cd-a5c1-40948ab4c79d","Type":"ContainerDied","Data":"5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee"}
Sep 17 14:45:03.799219 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:03.799161    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dd940b3f3c99a10311a5b35a884fca7d4d33d065be3249c8d8bac22d299d4ee"
Sep 17 14:45:26.508136 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:45:26.508047    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:46:09.599734 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:46:09.599690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:46:17.698653 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:46:17.698613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:46:26.110235 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:46:26.110200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:46:44.799373 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:46:44.799333    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:46:53.293727 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:46:53.293686    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:48:20.989885 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:48:20.989855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:48:29.191043 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:48:29.190950    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:48:37.397135 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:48:37.397094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:48:55.295528 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:48:55.295493    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:49:15.691457 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:49:15.691418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:49:48.421476 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:49:48.421439    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:49:58.090019 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:49:58.089937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:05.890211 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:05.890170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:06.112340 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112307    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:06.112620 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112609    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:50:06.112675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112622    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf72f9a4-92b8-482b-a7ea-b303406c01ea" containerName="istio-proxy"
Sep 17 14:50:06.112675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112638    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ec81c0-9b08-49cd-a5c1-40948ab4c79d" containerName="cleanup"
Sep 17 14:50:06.112675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112643    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ec81c0-9b08-49cd-a5c1-40948ab4c79d" containerName="cleanup"
Sep 17 14:50:06.112776 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.112710    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ec81c0-9b08-49cd-a5c1-40948ab4c79d" containerName="cleanup"
Sep 17 14:50:06.115737 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.115715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.118249 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.118217    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 14:50:06.119007 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.118990    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 14:50:06.119007 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.119002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-d65tq\""
Sep 17 14:50:06.119165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.119043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 14:50:06.119165 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.119115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 14:50:06.126960 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.126929    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"]
Sep 17 14:50:06.131378 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.131350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:06.131704 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.131689    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.142539 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.142480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"]
Sep 17 14:50:06.265154 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbsj9\" (UniqueName: \"kubernetes.io/projected/49f5853d-bd04-4c34-a423-53cd5a540285-kube-api-access-gbsj9\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.265258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.265258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49f5853d-bd04-4c34-a423-53cd5a540285-openshift-service-ca\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.265258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-metrics-certs\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.265258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.265258 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.265425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s6zc\" (UniqueName: \"kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.265425 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.265354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-maas-api-tls\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.366446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49f5853d-bd04-4c34-a423-53cd5a540285-openshift-service-ca\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.366446 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-metrics-certs\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.366670 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.366670 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.366670 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s6zc\" (UniqueName: \"kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.366828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-maas-api-tls\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.366828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbsj9\" (UniqueName: \"kubernetes.io/projected/49f5853d-bd04-4c34-a423-53cd5a540285-kube-api-access-gbsj9\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.366828 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.366806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.367243 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.367223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.367322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.367261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49f5853d-bd04-4c34-a423-53cd5a540285-openshift-service-ca\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.369159 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.369134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-maas-api-tls\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.369245 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.369172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.369507 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.369487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.369563 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.369487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5853d-bd04-4c34-a423-53cd5a540285-metrics-certs\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.374195 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.374176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s6zc\" (UniqueName: \"kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc\") pod \"maas-api-5ffb5cf8dc-prsw2\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") " pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.374728 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.374708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbsj9\" (UniqueName: \"kubernetes.io/projected/49f5853d-bd04-4c34-a423-53cd5a540285-kube-api-access-gbsj9\") pod \"maas-api-776dd778bc-fmrhm\" (UID: \"49f5853d-bd04-4c34-a423-53cd5a540285\") " pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.426322 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.426275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:06.448976 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.448954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:06.701540 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.701511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:06.705642 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:50:06.704312    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d4fbed_93b5_4a28_84e7_d046d7d460cd.slice/crio-0cb14623b42ae814f05e84628d4173e6c4e9ef7ce4c513f0f64f19750ea3aa5e WatchSource:0}: Error finding container 0cb14623b42ae814f05e84628d4173e6c4e9ef7ce4c513f0f64f19750ea3aa5e: Status 404 returned error can't find the container with id 0cb14623b42ae814f05e84628d4173e6c4e9ef7ce4c513f0f64f19750ea3aa5e
Sep 17 14:50:06.707380 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.707101    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:50:06.730033 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:06.730008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"]
Sep 17 14:50:06.731381 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:50:06.731355    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f5853d_bd04_4c34_a423_53cd5a540285.slice/crio-62ce3ea38ab42b4c0c0672782f65eb420c545c6cd9a19276620d4fd6bdd1bd81 WatchSource:0}: Error finding container 62ce3ea38ab42b4c0c0672782f65eb420c545c6cd9a19276620d4fd6bdd1bd81: Status 404 returned error can't find the container with id 62ce3ea38ab42b4c0c0672782f65eb420c545c6cd9a19276620d4fd6bdd1bd81
Sep 17 14:50:07.302976 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.302935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm" event={"ID":"49f5853d-bd04-4c34-a423-53cd5a540285","Type":"ContainerStarted","Data":"db4304ac5c3657b86331939e3827bad5b5c741c97585979e29ceaec2efcc61d8"}
Sep 17 14:50:07.303401 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.302999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm" event={"ID":"49f5853d-bd04-4c34-a423-53cd5a540285","Type":"ContainerStarted","Data":"62ce3ea38ab42b4c0c0672782f65eb420c545c6cd9a19276620d4fd6bdd1bd81"}
Sep 17 14:50:07.303401 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.303028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:07.304667 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.304647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" event={"ID":"92d4fbed-93b5-4a28-84e7-d046d7d460cd","Type":"ContainerStarted","Data":"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"}
Sep 17 14:50:07.304749 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.304689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" event={"ID":"92d4fbed-93b5-4a28-84e7-d046d7d460cd","Type":"ContainerStarted","Data":"0cb14623b42ae814f05e84628d4173e6c4e9ef7ce4c513f0f64f19750ea3aa5e"}
Sep 17 14:50:07.304798 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.304768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:07.343035 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.342981    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm" podStartSLOduration=0.835330312 podStartE2EDuration="1.342966165s" totalImagesPullingTime="507.635853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:50:07.340915502 +0000 UTC m=+2703.049788354" watchObservedRunningTime="2026-09-17 14:50:07.342966165 +0000 UTC m=+2703.051838980"
Sep 17 14:50:07.394034 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:07.393986    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" podStartSLOduration=0.908907155 podStartE2EDuration="1.393968373s" totalImagesPullingTime="485.061218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:50:07.393434959 +0000 UTC m=+2703.102307774" watchObservedRunningTime="2026-09-17 14:50:07.393968373 +0000 UTC m=+2703.102841191"
Sep 17 14:50:13.316225 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.316193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-776dd778bc-fmrhm"
Sep 17 14:50:13.316814 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.316616    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:13.386802 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.386771    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:13.386957 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.386929    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" podUID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" containerName="maas-api" containerID="cri-o://59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95" gracePeriod=30
Sep 17 14:50:13.623574 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.623523    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:13.721934 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.721908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca\") pod \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") "
Sep 17 14:50:13.722063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.721972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs\") pod \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") "
Sep 17 14:50:13.722063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.722038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s6zc\" (UniqueName: \"kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc\") pod \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") "
Sep 17 14:50:13.722181 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.722077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls\") pod \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\" (UID: \"92d4fbed-93b5-4a28-84e7-d046d7d460cd\") "
Sep 17 14:50:13.722278 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.722249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92d4fbed-93b5-4a28-84e7-d046d7d460cd" (UID: "92d4fbed-93b5-4a28-84e7-d046d7d460cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:50:13.724021 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.723996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc" (OuterVolumeSpecName: "kube-api-access-9s6zc") pod "92d4fbed-93b5-4a28-84e7-d046d7d460cd" (UID: "92d4fbed-93b5-4a28-84e7-d046d7d460cd"). InnerVolumeSpecName "kube-api-access-9s6zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:50:13.724124 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.724037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92d4fbed-93b5-4a28-84e7-d046d7d460cd" (UID: "92d4fbed-93b5-4a28-84e7-d046d7d460cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:50:13.724124 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.724063    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "92d4fbed-93b5-4a28-84e7-d046d7d460cd" (UID: "92d4fbed-93b5-4a28-84e7-d046d7d460cd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:50:13.786510 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.786480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:13.823171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.823148    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-metrics-certs\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:50:13.823171 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.823166    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s6zc\" (UniqueName: \"kubernetes.io/projected/92d4fbed-93b5-4a28-84e7-d046d7d460cd-kube-api-access-9s6zc\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:50:13.823299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.823178    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92d4fbed-93b5-4a28-84e7-d046d7d460cd-maas-api-tls\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:50:13.823299 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:13.823186    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92d4fbed-93b5-4a28-84e7-d046d7d460cd-openshift-service-ca\") on node \"ip-10-0-136-184.ec2.internal\" DevicePath \"\""
Sep 17 14:50:14.341912 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.341876    2560 generic.go:356] "Generic (PLEG): container finished" podID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" containerID="59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95" exitCode=0
Sep 17 14:50:14.342361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.341923    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"
Sep 17 14:50:14.342361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.341963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" event={"ID":"92d4fbed-93b5-4a28-84e7-d046d7d460cd","Type":"ContainerDied","Data":"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"}
Sep 17 14:50:14.342361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.342027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2" event={"ID":"92d4fbed-93b5-4a28-84e7-d046d7d460cd","Type":"ContainerDied","Data":"0cb14623b42ae814f05e84628d4173e6c4e9ef7ce4c513f0f64f19750ea3aa5e"}
Sep 17 14:50:14.342361 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.342064    2560 scope.go:117] "RemoveContainer" containerID="59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"
Sep 17 14:50:14.350678 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.350660    2560 scope.go:117] "RemoveContainer" containerID="59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"
Sep 17 14:50:14.350937 ip-10-0-136-184 kubenswrapper[2560]: E0917 14:50:14.350919    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95\": container with ID starting with 59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95 not found: ID does not exist" containerID="59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"
Sep 17 14:50:14.350982 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.350946    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95"} err="failed to get container status \"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95\": rpc error: code = NotFound desc = could not find container \"59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95\": container with ID starting with 59d978685fb1ffb5e8f61d3e5d03f3f3ad06c3ee92f84c210d4c43a9f5ffac95 not found: ID does not exist"
Sep 17 14:50:14.365466 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.365445    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:14.368952 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.368932    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ffb5cf8dc-prsw2"]
Sep 17 14:50:14.793772 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:14.793745    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" path="/var/lib/kubelet/pods/92d4fbed-93b5-4a28-84e7-d046d7d460cd/volumes"
Sep 17 14:50:20.903503 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:20.903463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:29.496276 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:29.496240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:34.788764 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:34.788727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2cskp"]
Sep 17 14:50:42.422657 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:42.422615    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v9gx4_04a72438-efba-4be0-84f1-e88becdd2fd6/manager/0.log"
Sep 17 14:50:43.162756 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:43.162723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7895599765-lkfhd_28bad35b-cf46-4f89-889a-0c0c48e3a00f/copy-manifests/0.log"
Sep 17 14:50:43.184682 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:43.184650    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7895599765-lkfhd_28bad35b-cf46-4f89-889a-0c0c48e3a00f/manager/0.log"
Sep 17 14:50:43.691246 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:43.691211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-776dd778bc-fmrhm_49f5853d-bd04-4c34-a423-53cd5a540285/maas-api/0.log"
Sep 17 14:50:44.067622 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:44.067527    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29827605-78zr8_74ec81c0-9b08-49cd-a5c1-40948ab4c79d/cleanup/0.log"
Sep 17 14:50:45.105134 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:45.105105    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bql2f_8045c64c-a0d1-410f-9b94-4408326a1f01/manager/0.log"
Sep 17 14:50:45.570111 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:45.570079    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2cskp_ca188fec-d519-40ad-8f95-ceeeda9d53a0/limitador/0.log"
Sep 17 14:50:45.700648 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:45.700602    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f5ss7_edc867f8-2033-40b8-93dd-b01dc2b6d44a/manager/0.log"
Sep 17 14:50:46.187395 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:46.187361    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s7nd9_241d76bf-7d42-437c-8ce8-280c4e51d6fa/discovery/0.log"
Sep 17 14:50:46.413698 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:46.413661    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6769664b-zvgzb_c4193e73-52de-4df8-8baf-99c3c31d7e0d/kube-auth-proxy/0.log"
Sep 17 14:50:47.539092 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:47.539062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-mn6bl_a8a3573c-678b-4916-9d0f-9bb83624662c/main/0.log"
Sep 17 14:50:47.664806 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:47.664770    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vsg8x_2c36d768-151c-434d-9176-3e705c5946d4/main/0.log"
Sep 17 14:50:47.895463 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:47.895367    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bsnj4_774f16a1-df6b-41df-891b-1f49e1391c15/main/0.log"
Sep 17 14:50:56.218920 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:56.218877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-brs66_169122e2-78b6-4046-8762-c339f73b10ec/global-pull-secret-syncer/0.log"
Sep 17 14:50:56.341066 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:56.341038    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8tl99_5852e837-7271-49c0-a9ce-06e7b6fbc840/konnectivity-agent/0.log"
Sep 17 14:50:56.437874 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:50:56.437847    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-184.ec2.internal_1d667033f2e5864bd6fbd882608a96f9/haproxy/0.log"
Sep 17 14:51:01.120870 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:01.120834    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bql2f_8045c64c-a0d1-410f-9b94-4408326a1f01/manager/0.log"
Sep 17 14:51:01.255339 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:01.255310    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2cskp_ca188fec-d519-40ad-8f95-ceeeda9d53a0/limitador/0.log"
Sep 17 14:51:01.332610 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:01.332585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f5ss7_edc867f8-2033-40b8-93dd-b01dc2b6d44a/manager/0.log"
Sep 17 14:51:03.080063 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:03.080028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5s69_1713b64e-53d3-4c6f-a5df-b5e77767731d/node-exporter/0.log"
Sep 17 14:51:03.113045 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:03.113018    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5s69_1713b64e-53d3-4c6f-a5df-b5e77767731d/kube-rbac-proxy/0.log"
Sep 17 14:51:03.143270 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:03.143245    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5s69_1713b64e-53d3-4c6f-a5df-b5e77767731d/init-textfile/0.log"
Sep 17 14:51:03.668015 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:03.667940    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pvsbn_cc8fe592-3a5c-4137-af65-6f3fce1c273b/prometheus-operator/0.log"
Sep 17 14:51:03.683145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:03.683117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-pvsbn_cc8fe592-3a5c-4137-af65-6f3fce1c273b/kube-rbac-proxy/0.log"
Sep 17 14:51:06.433190 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.433154    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"]
Sep 17 14:51:06.433717 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.433692    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" containerName="maas-api"
Sep 17 14:51:06.433717 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.433714    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" containerName="maas-api"
Sep 17 14:51:06.433840 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.433829    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d4fbed-93b5-4a28-84e7-d046d7d460cd" containerName="maas-api"
Sep 17 14:51:06.438046 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.438022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.441247 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.441225    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82mm4\"/\"openshift-service-ca.crt\""
Sep 17 14:51:06.441376 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.441246    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82mm4\"/\"kube-root-ca.crt\""
Sep 17 14:51:06.442206 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.442190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82mm4\"/\"default-dockercfg-qm296\""
Sep 17 14:51:06.452480 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.452457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"]
Sep 17 14:51:06.533945 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.533909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-proc\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.533945 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.533951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-podres\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.534104 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.533987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-sys\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.534104 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.534043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmblx\" (UniqueName: \"kubernetes.io/projected/886eec56-8c92-49e2-8dba-ca9b996af7d8-kube-api-access-hmblx\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.534104 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.534078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-lib-modules\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635156 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-sys\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmblx\" (UniqueName: \"kubernetes.io/projected/886eec56-8c92-49e2-8dba-ca9b996af7d8-kube-api-access-hmblx\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-lib-modules\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-proc\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-podres\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635283 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-sys\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635509 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-proc\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635509 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-lib-modules\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.635509 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.635443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886eec56-8c92-49e2-8dba-ca9b996af7d8-podres\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.643109 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.643087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmblx\" (UniqueName: \"kubernetes.io/projected/886eec56-8c92-49e2-8dba-ca9b996af7d8-kube-api-access-hmblx\") pod \"perf-node-gather-daemonset-h22ml\" (UID: \"886eec56-8c92-49e2-8dba-ca9b996af7d8\") " pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:06.748470 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:06.748416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:07.024083 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:07.024034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"]
Sep 17 14:51:07.026173 ip-10-0-136-184 kubenswrapper[2560]: W0917 14:51:07.026141    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod886eec56_8c92_49e2_8dba_ca9b996af7d8.slice/crio-1bf67b9327305f483282022b7497d98a897ddb523eb8318dbf57a36b414ceee7 WatchSource:0}: Error finding container 1bf67b9327305f483282022b7497d98a897ddb523eb8318dbf57a36b414ceee7: Status 404 returned error can't find the container with id 1bf67b9327305f483282022b7497d98a897ddb523eb8318dbf57a36b414ceee7
Sep 17 14:51:07.628342 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:07.628308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml" event={"ID":"886eec56-8c92-49e2-8dba-ca9b996af7d8","Type":"ContainerStarted","Data":"04f65e0721b83ec236933f277679222e38a2e7f9061c2e5697565a7a1970ef0d"}
Sep 17 14:51:07.628723 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:07.628374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml" event={"ID":"886eec56-8c92-49e2-8dba-ca9b996af7d8","Type":"ContainerStarted","Data":"1bf67b9327305f483282022b7497d98a897ddb523eb8318dbf57a36b414ceee7"}
Sep 17 14:51:07.628723 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:07.628402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:07.645790 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:07.645738    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml" podStartSLOduration=1.645723837 podStartE2EDuration="1.645723837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:51:07.64352978 +0000 UTC m=+2763.352402594" watchObservedRunningTime="2026-09-17 14:51:07.645723837 +0000 UTC m=+2763.354596650"
Sep 17 14:51:08.598589 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:08.598537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2wzm_6ed8eae9-31e1-4957-9980-4d3653a49cab/dns/0.log"
Sep 17 14:51:08.620886 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:08.620860    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q2wzm_6ed8eae9-31e1-4957-9980-4d3653a49cab/kube-rbac-proxy/0.log"
Sep 17 14:51:08.645750 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:08.645731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2bcx_18f540d4-9be9-4dd8-84e6-fe034aeb9123/dns-node-resolver/0.log"
Sep 17 14:51:09.374970 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:09.374936    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v69kn_4bde3f45-ccec-4cde-9123-ee6a980dda9b/node-ca/0.log"
Sep 17 14:51:11.026675 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:11.026646    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s7nd9_241d76bf-7d42-437c-8ce8-280c4e51d6fa/discovery/0.log"
Sep 17 14:51:11.074803 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:11.074779    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6769664b-zvgzb_c4193e73-52de-4df8-8baf-99c3c31d7e0d/kube-auth-proxy/0.log"
Sep 17 14:51:12.081644 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:12.081612    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnl7z_c88aa314-fdf6-4560-b730-4191a61b233d/serve-healthcheck-canary/0.log"
Sep 17 14:51:12.764611 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:12.764576    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr7jk_642c10dd-29b8-4acd-87ca-8ef2570c3371/kube-rbac-proxy/0.log"
Sep 17 14:51:12.782866 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:12.782840    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr7jk_642c10dd-29b8-4acd-87ca-8ef2570c3371/exporter/0.log"
Sep 17 14:51:12.802164 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:12.802138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rr7jk_642c10dd-29b8-4acd-87ca-8ef2570c3371/extractor/0.log"
Sep 17 14:51:13.643565 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:13.643521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-82mm4/perf-node-gather-daemonset-h22ml"
Sep 17 14:51:14.885152 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:14.885117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v9gx4_04a72438-efba-4be0-84f1-e88becdd2fd6/manager/0.log"
Sep 17 14:51:15.609667 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:15.609639    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7895599765-lkfhd_28bad35b-cf46-4f89-889a-0c0c48e3a00f/manager/0.log"
Sep 17 14:51:15.624311 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:15.624287    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7895599765-lkfhd_28bad35b-cf46-4f89-889a-0c0c48e3a00f/copy-manifests/0.log"
Sep 17 14:51:17.213492 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:17.213459    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kxgfk_8da66e6c-1824-4743-90ec-5b3ca440cf1d/openshift-lws-operator/0.log"
Sep 17 14:51:18.049145 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:18.049118    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s7nd9_241d76bf-7d42-437c-8ce8-280c4e51d6fa/discovery/0.log"
Sep 17 14:51:18.082068 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:18.081998    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6769664b-zvgzb_c4193e73-52de-4df8-8baf-99c3c31d7e0d/kube-auth-proxy/0.log"
Sep 17 14:51:20.353810 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:20.353777    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s7nd9_241d76bf-7d42-437c-8ce8-280c4e51d6fa/discovery/0.log"
Sep 17 14:51:20.387606 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:20.387578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6769664b-zvgzb_c4193e73-52de-4df8-8baf-99c3c31d7e0d/kube-auth-proxy/0.log"
Sep 17 14:51:22.274779 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:22.274747    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-65x57_03835140-1092-453a-90d3-c4641180c2fa/migrator/0.log"
Sep 17 14:51:22.293478 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:22.293455    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-65x57_03835140-1092-453a-90d3-c4641180c2fa/graceful-termination/0.log"
Sep 17 14:51:23.627467 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.627434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bdvg_b0f115e0-32d8-47af-a630-ac0d8972c7ce/kube-multus/0.log"
Sep 17 14:51:23.798814 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.798788    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/kube-multus-additional-cni-plugins/0.log"
Sep 17 14:51:23.820661 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.820639    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/egress-router-binary-copy/0.log"
Sep 17 14:51:23.844135 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.844109    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/cni-plugins/0.log"
Sep 17 14:51:23.866746 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.866726    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/bond-cni-plugin/0.log"
Sep 17 14:51:23.889591 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.889515    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/routeoverride-cni/0.log"
Sep 17 14:51:23.914036 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.914019    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/whereabouts-cni-bincopy/0.log"
Sep 17 14:51:23.933943 ip-10-0-136-184 kubenswrapper[2560]: I0917 14:51:23.933920    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rg2zs_b8d1479d-0939-409c-a686-b6e6cec125d7/whereabouts-cni/0.log"