Sep 10 22:18:13.311766 ip-10-0-132-64 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 22:18:13.671253 ip-10-0-132-64 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:13.671253 ip-10-0-132-64 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 22:18:13.671253 ip-10-0-132-64 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:13.671253 ip-10-0-132-64 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 22:18:13.671253 ip-10-0-132-64 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:13.672268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.672049    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 22:18:13.675271 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675248    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.675271 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675266    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.675271 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675271    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.675271 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675277    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675281    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675285    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675291    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675297    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675301    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675305    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675309    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675313    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675317    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675322    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675328    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675332    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675336    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675340    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675344    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675348    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675353    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675357    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675361    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.675582 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675365    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675369    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675373    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675377    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675381    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675385    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675389    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675393    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675397    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675402    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675406    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675410    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675415    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675419    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675425    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675430    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675435    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675441    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675445    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675449    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.676394 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675454    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675459    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675463    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675468    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675472    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675477    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675484    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675504    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675509    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675513    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675517    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675522    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675526    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675530    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675535    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675539    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675543    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675547    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675551    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.677260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675556    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675560    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675564    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675568    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675572    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675576    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675582    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675587    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675592    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675596    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675600    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675605    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675609    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675614    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675618    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675622    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675626    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675631    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675635    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675639    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.678069 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675643    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675647    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675651    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675655    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675659    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675664    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675668    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675673    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675677    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675683    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675689    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675694    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675699    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675704    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675708    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675712    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.675716    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676872    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676883    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.678933 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676890    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676894    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676899    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676910    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676915    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676919    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676924    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676928    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676932    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676937    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676941    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676945    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676950    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676955    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676959    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676963    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676967    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676971    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676976    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676980    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.679741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676984    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676988    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676992    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.676996    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677000    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677004    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677008    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677012    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677016    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677021    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677026    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677030    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677034    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677039    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677043    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677047    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677058    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677063    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677067    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677071    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.680466 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677076    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677080    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677091    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677095    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677099    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677104    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677108    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677112    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677116    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677120    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677125    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677132    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677138    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677142    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677147    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677151    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677155    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677159    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677163    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.681013 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677167    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677172    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677176    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677180    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677188    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677193    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677198    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677202    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677206    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677210    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677215    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677219    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677223    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677227    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677231    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677235    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677241    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677245    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677250    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.681567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677254    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677260    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677265    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677271    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677276    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677280    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677284    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677289    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677293    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677298    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677302    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677307    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677311    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677315    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677319    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677324    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677331    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677338    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677343    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.682224 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677959    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677968    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677973    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677977    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677983    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677988    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.677995    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678001    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678006    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678011    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678015    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678020    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678024    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678029    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678034    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678040    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678044    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678048    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678053    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.682741 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678057    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678061    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678065    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678069    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678073    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678077    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678081    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678085    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678089    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678093    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678097    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678102    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678106    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678110    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678114    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678118    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678123    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678127    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678132    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678137    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.683291 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678141    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678145    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678149    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678153    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678157    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678164    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678170    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678174    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678179    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678184    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678188    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678192    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678197    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678201    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678205    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678209    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678215    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678219    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678223    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.683807 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678227    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678232    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678236    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678240    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678245    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678249    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678253    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678258    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678265    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678269    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678273    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678278    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678284    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678288    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678294    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678298    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678302    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678306    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678310    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678314    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.684256 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678319    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678323    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678327    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678331    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678335    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678339    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678343    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678347    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678351    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678357    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678363    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678368    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678372    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678376    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678380    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678384    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678388    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678393    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678397    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678401    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.684770 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.678407    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678522    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678572    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678582    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678589    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678596    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678601    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678608    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678614    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678619    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678624    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678630    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678635    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678640    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678645    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678650    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678664    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678669    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678674    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678679    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678684    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678689    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678694    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678700    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 22:18:13.685249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678705    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678710    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678715    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678720    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678725    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678729    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678734    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678739    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678747    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678753    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678758    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678762    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678767    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678772    2559 flags.go:64] FLAG: --enable-server="true"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678777    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678784    2559 flags.go:64] FLAG: --event-burst="100"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678789    2559 flags.go:64] FLAG: --event-qps="50"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678794    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678799    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678803    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678809    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678813    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678818    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678823    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678828    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 22:18:13.685908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678832    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678837    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678842    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678847    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678851    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678856    2559 flags.go:64] FLAG: --feature-gates=""
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678862    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678867    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678871    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678879    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678884    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678889    2559 flags.go:64] FLAG: --help="false"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678893    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-64.ec2.internal"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678898    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678903    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678910    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678916    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678921    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678926    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678931    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678935    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678939    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678945    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678950    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 22:18:13.686578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678954    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678959    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678963    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678968    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678973    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678978    2559 flags.go:64] FLAG: --lock-file=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678983    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678987    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.678992    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679000    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679005    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679010    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679015    2559 flags.go:64] FLAG: --logging-format="text"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679020    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679025    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679030    2559 flags.go:64] FLAG: --manifest-url=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679035    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679043    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679048    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679054    2559 flags.go:64] FLAG: --max-pods="110"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679059    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679063    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679068    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679075    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679080    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 22:18:13.687177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679084    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679089    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679101    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679106    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679111    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679116    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679121    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679129    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679134    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679140    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679144    2559 flags.go:64] FLAG: --port="10250"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679149    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679154    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a11230b946a11cb5"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679159    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679163    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679168    2559 flags.go:64] FLAG: --register-node="true"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679173    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679179    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679183    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679188    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679192    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679198    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679203    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679208    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679213    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 22:18:13.687806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679220    2559 flags.go:64] FLAG: --runonce="false"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679224    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679230    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679234    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679239    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679245    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679249    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679255    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679259    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679264    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679269    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679273    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679278    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679283    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679289    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679293    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679312    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679317    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679322    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679328    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679332    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679337    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679341    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679346    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679351    2559 flags.go:64] FLAG: --v="2"
Sep 10 22:18:13.688400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679357    2559 flags.go:64] FLAG: --version="false"
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679363    2559 flags.go:64] FLAG: --vmodule=""
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679369    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.679374    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679610    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679618    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679623    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679630    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679635    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679639    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679644    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679648    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679654    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679658    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679663    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679667    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679671    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679675    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679679    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679684    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.689117 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679689    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679693    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679698    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679702    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679706    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679710    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679715    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679719    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679724    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679728    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679734    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679740    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679744    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679748    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679752    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679756    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679760    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679765    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679769    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.689659 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679775    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679780    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679787    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679792    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679796    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679802    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679806    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679813    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679818    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679823    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679827    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679833    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679837    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679842    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679846    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679850    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679855    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679861    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679866    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.690129 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679870    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679875    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679879    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679883    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679888    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679892    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679896    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679900    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679905    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679909    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679913    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679917    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679922    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679927    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679931    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679936    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679940    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679944    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679951    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679955    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.690620 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679960    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679964    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679968    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679972    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679977    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679981    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679985    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679989    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679994    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.679998    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680003    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680008    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680012    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680016    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680020    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680024    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680028    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680032    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680036    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680040    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.691118 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680045    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680049    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680052    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680057    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.680061    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.680074    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688051    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688070    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688083    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688088    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688160    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688165    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688168    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688172    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688175    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.691621 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688178    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688182    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688184    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688187    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688190    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688193    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688196    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688199    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688201    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688204    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688207    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688209    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688212    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688215    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688217    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688220    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688223    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688225    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688228    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688231    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.691996 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688234    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688237    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688239    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688242    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688251    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688254    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688257    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688265    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688268    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688271    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688273    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688276    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688279    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688281    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688284    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688288    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688292    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688294    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688297    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688300    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.692476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688303    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688305    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688308    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688312    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688315    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688319    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688322    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688324    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688327    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688330    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688333    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688335    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688338    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688341    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688343    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688346    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688349    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688357    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688360    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.693007 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688363    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688365    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688368    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688370    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688373    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688376    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688378    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688381    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688384    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688386    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688389    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688391    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688394    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688397    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688399    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688402    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688405    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688407    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688410    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688413    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.693461 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688415    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688418    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688421    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688424    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688426    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688429    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688431    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688434    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688436    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688439    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688442    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688450    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688453    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688456    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.693967 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688460    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688465    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688640    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688646    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688648    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688651    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688654    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688657    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688659    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688662    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688665    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688667    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688671    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688676    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688679    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:13.694304 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688682    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688685    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688687    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688690    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688693    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688696    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688698    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688701    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688704    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688706    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688709    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688711    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688714    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688716    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688719    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688727    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688730    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688732    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688735    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688737    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:13.694695 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688740    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688743    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688745    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688748    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688750    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688753    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688755    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688758    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688760    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688763    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688765    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688768    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688770    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688774    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688777    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688780    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688783    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688787    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688789    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:13.695173 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688792    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688796    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688800    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688803    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688806    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688809    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688812    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688814    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688817    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688825    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688828    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688831    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688833    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688836    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688838    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688841    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688843    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688846    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688848    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688851    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:13.695632 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688853    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688856    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688858    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688861    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688863    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688866    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688868    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688871    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688873    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688876    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688879    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688881    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688884    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688886    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688889    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688892    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688894    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688897    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688900    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688902    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:13.696105 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688905    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688907    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688915    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688918    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688920    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688923    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:13.688925    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.688931    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.689044    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.691358    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.692166    2559 server.go:1019] "Starting client certificate rotation"
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.692259    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.692287    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:18:13.696600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.694689    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:18:13.697411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.697392    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:18:13.705702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.705684    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 10 22:18:13.708915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.708901    2559 log.go:25] "Validated CRI v1 image API"
Sep 10 22:18:13.710790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.710769    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 22:18:13.715428 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.715410    2559 fs.go:135] Filesystem UUIDs: map[175712ee-d4d3-4fd1-b725-066073035614:/dev/nvme0n1p3 1ea7ff72-e7bd-4e6d-a3b7-6e2754f98626:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 10 22:18:13.715482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.715428    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 22:18:13.720811 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.720695    2559 manager.go:216] Machine: {Timestamp:2026-09-10 22:18:13.719603044 +0000 UTC m=+0.303680076 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097512 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e3c6b98bf63652984c68e95e12ece SystemUUID:ec2e3c6b-98bf-6365-2984-c68e95e12ece BootID:44243641-1c90-498e-9162-ecb9eb7e6d6f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:dd:7c:0d:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:dd:7c:0d:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:13:a5:fc:8f:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 22:18:13.720811 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.720808    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 22:18:13.720931 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.720920    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 22:18:13.723753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.723731    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 22:18:13.723892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.723757    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 22:18:13.724536 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.724527    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 22:18:13.724571 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.724539    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 22:18:13.724571 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.724547    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:18:13.725228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.725215    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:18:13.726360 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.726348    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 22:18:13.729595 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.729574    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:18:13.730359 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730345    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:18:13.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730504    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 22:18:13.730573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730543    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 22:18:13.730573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730564    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 22:18:13.730663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730583    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 22:18:13.730663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730599    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 10 22:18:13.730663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.730613    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 22:18:13.731037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.731023    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:18:13.731098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.731047    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:18:13.732996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.732977    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 22:18:13.735535 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.735522    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 22:18:13.735594 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.735552    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 22:18:13.737408 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737397    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 22:18:13.737450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737412    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 22:18:13.737450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737418    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 22:18:13.737450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737423    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 22:18:13.737450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737431    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 22:18:13.737450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737437    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737456    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737461    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737467    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737472    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737500    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 22:18:13.737600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.737508    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 22:18:13.738217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.738207    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 22:18:13.738217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.738217    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 22:18:13.740554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.740538    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 22:18:13.740661 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.740639    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 22:18:13.740705 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.740639    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 22:18:13.742059 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.742047    2559 server.go:1268] "Started kubelet"
Sep 10 22:18:13.742211 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.742183    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 22:18:13.742437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.742368    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 22:18:13.742596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.742582    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 22:18:13.743153 ip-10-0-132-64 systemd[1]: Started Kubernetes Kubelet.
Sep 10 22:18:13.747069 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.747014    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 22:18:13.750114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.750083    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 22:18:13.750868 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.750844    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 22:18:13.751075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.751057    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gd8m9"
Sep 10 22:18:13.753168 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.751969    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-64.ec2.internal.18d41597cfb65733  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-64.ec2.internal,UID:ip-10-0-132-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-64.ec2.internal,},FirstTimestamp:2026-09-10 22:18:13.742008115 +0000 UTC m=+0.326085146,LastTimestamp:2026-09-10 22:18:13.742008115 +0000 UTC m=+0.326085146,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-64.ec2.internal,}"
Sep 10 22:18:13.755662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.755644    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 22:18:13.756271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.756252    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 22:18:13.756413 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.756396    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:13.757001 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.756974    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 22:18:13.757001 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.756975    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757010    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757038    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757048    2559 factory.go:55] Registering systemd factory
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757055    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757107    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 22:18:13.757121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757118    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 22:18:13.757331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757319    2559 factory.go:153] Registering CRI-O factory
Sep 10 22:18:13.757364 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757332    2559 factory.go:223] Registration of the crio container factory successfully
Sep 10 22:18:13.757364 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757347    2559 factory.go:103] Registering Raw factory
Sep 10 22:18:13.757364 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757356    2559 manager.go:1196] Started watching for new ooms in manager
Sep 10 22:18:13.757737 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.757726    2559 manager.go:349] Starting recovery of all containers
Sep 10 22:18:13.758270 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.758244    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 22:18:13.758377 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.758356    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 22:18:13.759840 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.759816    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gd8m9"
Sep 10 22:18:13.769710 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.769625    2559 manager.go:354] Recovery completed
Sep 10 22:18:13.770949 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.770932    2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 10 22:18:13.774185 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.774174    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.775917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.775900    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.776002 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.775931    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.776002 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.775945    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.777074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777055    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 22:18:13.777135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777074    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 22:18:13.777135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777075    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.777135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777093    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:18:13.777763 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777743    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.777834 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777778    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.777834 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.777795    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.778238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.778226    2559 policy_none.go:49] "None policy: Start"
Sep 10 22:18:13.778271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.778242    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 22:18:13.778271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.778252    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 22:18:13.779232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.779219    2559 policy_none.go:47] "Start"
Sep 10 22:18:13.806057 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.806041    2559 manager.go:337] "Starting Device Plugin manager"
Sep 10 22:18:13.806140 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.806081    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 22:18:13.806140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.806094    2559 server.go:87] "Starting device plugin registration server"
Sep 10 22:18:13.807055 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.807029    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.807117    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.807601    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.807713    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.807723    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.808619    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 22:18:13.825212 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.808668    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:13.883599 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.883573    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 22:18:13.884716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.884698    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 22:18:13.884788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.884760    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 22:18:13.884788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.884785    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 22:18:13.884888 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.884873    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 22:18:13.887079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.887063    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:13.907806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.907782    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.908750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.908736    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.908817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.908761    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.908817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.908772    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.908817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.908793    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-64.ec2.internal"
Sep 10 22:18:13.918083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.918068    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-64.ec2.internal"
Sep 10 22:18:13.918129 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.918089    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-64.ec2.internal\": node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:13.933327 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:13.933279    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:13.985219 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.985199    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"]
Sep 10 22:18:13.985285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.985260    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.986729 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.986715    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.986798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.986742    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.986798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.986757    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.987955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.987943    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.988079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:13.988116 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988094    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.988637 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988620    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.988724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988621    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.988724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988678    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.988724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988690    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.988724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988652    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.988724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.988721    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:13.989897 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.989880    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:13.989962 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.989911    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:13.990512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.990481    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:13.990605 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.990526    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:13.990605 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:13.990540    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:14.013093 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.013071    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-64.ec2.internal\" not found" node="ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.017399 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.017383    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-64.ec2.internal\" not found" node="ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.033392 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.033371    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.058301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.058280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843de8051e5b09f0a1842ff02cf35f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"843de8051e5b09f0a1842ff02cf35f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.058301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.058301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.058424 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.058316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.134355 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.134334    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.158524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843de8051e5b09f0a1842ff02cf35f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"843de8051e5b09f0a1842ff02cf35f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.158597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.158597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.158597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.158597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/843de8051e5b09f0a1842ff02cf35f50-config\") pod \"kube-apiserver-proxy-ip-10-0-132-64.ec2.internal\" (UID: \"843de8051e5b09f0a1842ff02cf35f50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.158782 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.158608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b4b02dd24e9af8850a0a47d5c9d4df8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal\" (UID: \"2b4b02dd24e9af8850a0a47d5c9d4df8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.234921 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.234866    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.317338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.317311    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.321917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.321654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:14.334969 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.334950    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.435374 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.435353    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.535882 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.535822    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.636284 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.636251    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.694011 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.693990    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 22:18:14.694639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.694120    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:18:14.736558 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.736526    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.765366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.765336    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 22:13:14 +0000 UTC" deadline="2028-05-02 20:01:59.286841444 +0000 UTC"
Sep 10 22:18:14.765366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.765362    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14397h43m44.521482507s"
Sep 10 22:18:14.837512 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.837295    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.938062 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:14.938030    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-64.ec2.internal\" not found"
Sep 10 22:18:14.973473 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:14.973442    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843de8051e5b09f0a1842ff02cf35f50.slice/crio-6a32e09ce2a093b71f4ca9e61123e08cc902fb7e9b03ee3b7291c8fae89ca9c7 WatchSource:0}: Error finding container 6a32e09ce2a093b71f4ca9e61123e08cc902fb7e9b03ee3b7291c8fae89ca9c7: Status 404 returned error can't find the container with id 6a32e09ce2a093b71f4ca9e61123e08cc902fb7e9b03ee3b7291c8fae89ca9c7
Sep 10 22:18:14.974123 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:14.974099    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4b02dd24e9af8850a0a47d5c9d4df8.slice/crio-1328d49fb0ef4b4811b4b6adc2b23c8cf63cee0cf7d8d93064add690c1f03e8b WatchSource:0}: Error finding container 1328d49fb0ef4b4811b4b6adc2b23c8cf63cee0cf7d8d93064add690c1f03e8b: Status 404 returned error can't find the container with id 1328d49fb0ef4b4811b4b6adc2b23c8cf63cee0cf7d8d93064add690c1f03e8b
Sep 10 22:18:14.981165 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:14.981143    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:18:15.013175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.013152    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:15.020325 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.020306    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:15.057600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.057583    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:15.069793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.069776    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:18:15.071690 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.071678    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal"
Sep 10 22:18:15.083377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.083360    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:18:15.202757 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.202672    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:15.733295 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.733265    2559 apiserver.go:52] "Watching apiserver"
Sep 10 22:18:15.741421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.741394    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 22:18:15.743644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.743609    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-5kkst","openshift-network-operator/iptables-alerter-nppsj","kube-system/global-pull-secret-syncer-bvb2n","kube-system/konnectivity-agent-9k5kd","openshift-image-registry/node-ca-swvxp","openshift-multus/multus-4nzqz","openshift-network-diagnostics/network-check-target-kng8t","openshift-ovn-kubernetes/ovnkube-node-pzf6h","kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx","openshift-cluster-node-tuning-operator/tuned-h5z8r","openshift-dns/node-resolver-gnmw7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-84hxt"]
Sep 10 22:18:15.745414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.745393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:15.745515 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.745477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:15.746919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.746900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.750628 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.750610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.750728 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.750685    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:15.759211 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.759183    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 22:18:15.759307 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.759225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.759901 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.759878    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.760941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.760083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.760941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.760206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.760941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.760290    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lplpg\""
Sep 10 22:18:15.762836 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.762596    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 22:18:15.762836 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.762803    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rj4cd\""
Sep 10 22:18:15.763411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.763328    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 22:18:15.764941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.764407    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c8wjg\""
Sep 10 22:18:15.764941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.764443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.764941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.764490    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.764941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.764547    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.764941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.764847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.766448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.765903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.766620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.766598    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p2qb\" (UniqueName: \"kubernetes.io/projected/ee2dd735-fe88-43be-babd-473a22a673a9-kube-api-access-5p2qb\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73556dbc-5492-42c9-a631-d8eb6c50d08c-agent-certs\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73556dbc-5492-42c9-a631-d8eb6c50d08c-konnectivity-ca\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-host\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-modprobe-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-serviceca\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbs5\" (UniqueName: \"kubernetes.io/projected/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-kube-api-access-jkbs5\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-kubernetes\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-tmp\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-kubelet-config\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-dbus\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767486    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-systemd\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-sys\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-lib-modules\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.767967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-var-lib-kubelet\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-host\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767808    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767825    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l2nxd\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767891    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.767823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysconfig\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-conf\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-run\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-etc-tuned\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768208    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57pdx\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768256    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.768956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.768826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.769780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 22:18:15.769780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769143    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 22:18:15.769780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769228    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 22:18:15.769780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769521    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5pksw\""
Sep 10 22:18:15.769780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769651    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.770038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.769858    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.770038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.770023    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 22:18:15.770369 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.770343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.770446 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.770422    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:15.772031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.771764    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.772031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.771865    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 22:18:15.772942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.772353    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.772942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.772776    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.773602 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.773555    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s8xk7\""
Sep 10 22:18:15.773785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.773763    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.773872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.773843    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 22:18:15.774119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.774075    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5b4mw\""
Sep 10 22:18:15.774891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.774857    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-858hx\""
Sep 10 22:18:15.774891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.774870    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.775049 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.774972    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 22:18:15.775321 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.775304    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 22:18:15.775683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.775641    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:18:15.801156 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.801133    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqhvx"
Sep 10 22:18:15.807268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.807249    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqhvx"
Sep 10 22:18:15.858141 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.858120    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 22:18:15.868366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.868470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cni-binary-copy\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.868470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.868470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdz5\" (UniqueName: \"kubernetes.io/projected/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-kube-api-access-czdz5\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.868470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-netns\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-config\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-script-lib\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9767e157-2180-4cf2-adaa-224044d181f6-host-slash\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-conf-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.868624    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.868704    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:16.368681448 +0000 UTC m=+2.952758489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-daemon-config\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.868785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-binary-copy\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-conf\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73556dbc-5492-42c9-a631-d8eb6c50d08c-agent-certs\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73556dbc-5492-42c9-a631-d8eb6c50d08c-konnectivity-ca\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.868897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-conf\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-serviceca\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-kubernetes\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-kubelet\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869414    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73556dbc-5492-42c9-a631-d8eb6c50d08c-konnectivity-ca\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-kubernetes\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-hostroot\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-etc-kubernetes\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-system-cni-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-etc-tuned\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-device-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-system-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysconfig\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.869833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-systemd-units\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-systemd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysconfig\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-serviceca\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wmt\" (UniqueName: \"kubernetes.io/projected/9767e157-2180-4cf2-adaa-224044d181f6-kube-api-access-c9wmt\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.869992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-host\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-modprobe-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-node-log\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-log-socket\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-sys-fs\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-modprobe-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-host\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6a278a5-3036-4c64-a636-0752c2354cd2-hosts-file\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbs5\" (UniqueName: \"kubernetes.io/projected/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-kube-api-access-jkbs5\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-kubelet-config\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-dbus\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.870524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-socket-dir-parent\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-bin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-kubelet-config\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36d2fc78-340f-4d22-961c-8e70b440d188-dbus\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cnibin\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftk9n\" (UniqueName: \"kubernetes.io/projected/5eaf4be1-2e47-454b-b351-f46c542f644a-kube-api-access-ftk9n\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-systemd\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2qb\" (UniqueName: \"kubernetes.io/projected/ee2dd735-fe88-43be-babd-473a22a673a9-kube-api-access-5p2qb\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-systemd\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-bin\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9767e157-2180-4cf2-adaa-224044d181f6-iptables-alerter-script\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870526    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a278a5-3036-4c64-a636-0752c2354cd2-tmp-dir\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-kubelet\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bwxw\" (UniqueName: \"kubernetes.io/projected/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-kube-api-access-4bwxw\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-k8s-cni-cncf-io\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-netns\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.871440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-multus\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovn-node-metrics-cert\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9swh\" (UniqueName: \"kubernetes.io/projected/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-kube-api-access-s9swh\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6fm\" (UniqueName: \"kubernetes.io/projected/b6a278a5-3036-4c64-a636-0752c2354cd2-kube-api-access-vg6fm\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-tmp\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-var-lib-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-netd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cnibin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.870979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-socket-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-sys\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-lib-modules\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-var-lib-kubelet\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-host\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-slash\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.872490 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-etc-sysctl-d\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-sys\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-ovn\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-multus-certs\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-var-lib-kubelet\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-run\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-lib-modules\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-etc-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-host\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-env-overrides\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee2dd735-fe88-43be-babd-473a22a673a9-run\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4m9\" (UniqueName: \"kubernetes.io/projected/17154967-f5fb-4eb0-b868-97d01004afcb-kube-api-access-gl4m9\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.871376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-registration-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.873505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.873325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73556dbc-5492-42c9-a631-d8eb6c50d08c-agent-certs\") pod \"konnectivity-agent-9k5kd\" (UID: \"73556dbc-5492-42c9-a631-d8eb6c50d08c\") " pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:15.874331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.874208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-tmp\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.874654 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.874634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee2dd735-fe88-43be-babd-473a22a673a9-etc-tuned\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.876007 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.875706    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:15.876007 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.875729    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:15.876007 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.875744    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:15.876007 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.875808    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:16.375791404 +0000 UTC m=+2.959868433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:15.880763 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.880737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbs5\" (UniqueName: \"kubernetes.io/projected/810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7-kube-api-access-jkbs5\") pod \"node-ca-swvxp\" (UID: \"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7\") " pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:15.881726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.881704    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p2qb\" (UniqueName: \"kubernetes.io/projected/ee2dd735-fe88-43be-babd-473a22a673a9-kube-api-access-5p2qb\") pod \"tuned-h5z8r\" (UID: \"ee2dd735-fe88-43be-babd-473a22a673a9\") " pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:15.890616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.890567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"2b4b02dd24e9af8850a0a47d5c9d4df8","Type":"ContainerStarted","Data":"1328d49fb0ef4b4811b4b6adc2b23c8cf63cee0cf7d8d93064add690c1f03e8b"}
Sep 10 22:18:15.892281 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.892252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" event={"ID":"843de8051e5b09f0a1842ff02cf35f50","Type":"ContainerStarted","Data":"6a32e09ce2a093b71f4ca9e61123e08cc902fb7e9b03ee3b7291c8fae89ca9c7"}
Sep 10 22:18:15.971680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bwxw\" (UniqueName: \"kubernetes.io/projected/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-kube-api-access-4bwxw\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.971680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-k8s-cni-cncf-io\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-netns\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-multus\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovn-node-metrics-cert\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.971876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9swh\" (UniqueName: \"kubernetes.io/projected/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-kube-api-access-s9swh\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6fm\" (UniqueName: \"kubernetes.io/projected/b6a278a5-3036-4c64-a636-0752c2354cd2-kube-api-access-vg6fm\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-var-lib-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-netd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cnibin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-socket-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.971997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-slash\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972028    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-k8s-cni-cncf-io\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-netns\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-ovn\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-ovn\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-slash\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cnibin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.972212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-var-lib-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-multus\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-multus-certs\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-socket-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-netd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-etc-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-run-multus-certs\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-etc-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-env-overrides\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4m9\" (UniqueName: \"kubernetes.io/projected/17154967-f5fb-4eb0-b868-97d01004afcb-kube-api-access-gl4m9\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-registration-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cni-binary-copy\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdz5\" (UniqueName: \"kubernetes.io/projected/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-kube-api-access-czdz5\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972564    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-registration-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-netns\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-config\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.972951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-script-lib\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9767e157-2180-4cf2-adaa-224044d181f6-host-slash\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-conf-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-daemon-config\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-binary-copy\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-conf-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-kubelet\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-hostroot\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-etc-kubernetes\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-system-cni-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9767e157-2180-4cf2-adaa-224044d181f6-host-slash\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.974095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-device-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973403    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-system-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-systemd-units\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-systemd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wmt\" (UniqueName: \"kubernetes.io/projected/9767e157-2180-4cf2-adaa-224044d181f6-kube-api-access-c9wmt\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-config\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-node-log\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-log-socket\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-sys-fs\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973672    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-netns\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-cni-binary-copy\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6a278a5-3036-4c64-a636-0752c2354cd2-hosts-file\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-socket-dir-parent\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovnkube-script-lib\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.975225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-bin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-cni-bin\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cnibin\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftk9n\" (UniqueName: \"kubernetes.io/projected/5eaf4be1-2e47-454b-b351-f46c542f644a-kube-api-access-ftk9n\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-etc-kubernetes\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-system-cni-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-bin\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-openvswitch\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-device-dir\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-cni-bin\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-system-cni-dir\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-systemd-units\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974137    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-run-systemd\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cni-binary-copy\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-host-var-lib-kubelet\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-cnibin\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-daemon-config\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-hostroot\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-log-socket\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-node-log\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6a278a5-3036-4c64-a636-0752c2354cd2-hosts-file\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.973923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9767e157-2180-4cf2-adaa-224044d181f6-iptables-alerter-script\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-run-ovn-kubernetes\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a278a5-3036-4c64-a636-0752c2354cd2-tmp-dir\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-multus-socket-dir-parent\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-kubelet\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9767e157-2180-4cf2-adaa-224044d181f6-iptables-alerter-script\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-host-kubelet\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eaf4be1-2e47-454b-b351-f46c542f644a-sys-fs\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-ovn-node-metrics-cert\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a278a5-3036-4c64-a636-0752c2354cd2-tmp-dir\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.974709    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:15.976906 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:15.974803    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:16.474774063 +0000 UTC m=+3.058851092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:15.977837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.974934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.977837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.975295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-env-overrides\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.980907 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.980881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9swh\" (UniqueName: \"kubernetes.io/projected/6dc0fe57-4546-42c2-87ba-4b26d3dc56f6-kube-api-access-s9swh\") pod \"multus-4nzqz\" (UID: \"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6\") " pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:15.982830 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.982799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6fm\" (UniqueName: \"kubernetes.io/projected/b6a278a5-3036-4c64-a636-0752c2354cd2-kube-api-access-vg6fm\") pod \"node-resolver-gnmw7\" (UID: \"b6a278a5-3036-4c64-a636-0752c2354cd2\") " pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:15.982935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.982898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wmt\" (UniqueName: \"kubernetes.io/projected/9767e157-2180-4cf2-adaa-224044d181f6-kube-api-access-c9wmt\") pod \"iptables-alerter-nppsj\" (UID: \"9767e157-2180-4cf2-adaa-224044d181f6\") " pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:15.983348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.983295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdz5\" (UniqueName: \"kubernetes.io/projected/ccddfa35-ccf0-4c08-a2d5-3ed840100cac-kube-api-access-czdz5\") pod \"multus-additional-cni-plugins-84hxt\" (UID: \"ccddfa35-ccf0-4c08-a2d5-3ed840100cac\") " pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:15.983439 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.983403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bwxw\" (UniqueName: \"kubernetes.io/projected/6335c6fe-ec20-4ff0-b57a-96b443a0fd88-kube-api-access-4bwxw\") pod \"ovnkube-node-pzf6h\" (UID: \"6335c6fe-ec20-4ff0-b57a-96b443a0fd88\") " pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:15.983632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.983601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4m9\" (UniqueName: \"kubernetes.io/projected/17154967-f5fb-4eb0-b868-97d01004afcb-kube-api-access-gl4m9\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:15.983835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:15.983814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftk9n\" (UniqueName: \"kubernetes.io/projected/5eaf4be1-2e47-454b-b351-f46c542f644a-kube-api-access-ftk9n\") pod \"aws-ebs-csi-driver-node-hnlcx\" (UID: \"5eaf4be1-2e47-454b-b351-f46c542f644a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:16.070005 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.069962    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h5z8r"
Sep 10 22:18:16.079316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.079289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:16.091275 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.091253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swvxp"
Sep 10 22:18:16.099294 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.099270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4nzqz"
Sep 10 22:18:16.107182 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.107160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84hxt"
Sep 10 22:18:16.115076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.115054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:16.122822 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.122803    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nppsj"
Sep 10 22:18:16.132847 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.132825    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx"
Sep 10 22:18:16.139653 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.139626    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gnmw7"
Sep 10 22:18:16.188051 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.188029    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:16.377502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.377404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:16.377502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.377463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:16.377709 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377594    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:16.377709 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377641    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:16.377709 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377661    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:16.377709 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377675    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:16.377709 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377675    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:17.377655157 +0000 UTC m=+3.961732178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:16.377934 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.377730    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:17.377717577 +0000 UTC m=+3.961794597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:16.478468 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.478429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:16.478639 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.478579    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:16.478716 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.478661    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:17.478640406 +0000 UTC m=+4.062717428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:16.810322 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.810209    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:13:16 +0000 UTC" deadline="2028-04-10 21:04:58.686022612 +0000 UTC"
Sep 10 22:18:16.810322 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.810277    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13870h46m41.875761102s"
Sep 10 22:18:16.885962 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:16.885927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:16.886129 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:16.886070    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:17.069295 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.069178    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a278a5_3036_4c64_a636_0752c2354cd2.slice/crio-00b823b7e55ac6d1cbfa31e7f4d3e73fa530333133e4b784cb7abe3c737e8363 WatchSource:0}: Error finding container 00b823b7e55ac6d1cbfa31e7f4d3e73fa530333133e4b784cb7abe3c737e8363: Status 404 returned error can't find the container with id 00b823b7e55ac6d1cbfa31e7f4d3e73fa530333133e4b784cb7abe3c737e8363
Sep 10 22:18:17.070279 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.070249    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc0fe57_4546_42c2_87ba_4b26d3dc56f6.slice/crio-5c8a5e1545d5ed232d1dba30b3537d5088ef44a01881676ab75086608f296410 WatchSource:0}: Error finding container 5c8a5e1545d5ed232d1dba30b3537d5088ef44a01881676ab75086608f296410: Status 404 returned error can't find the container with id 5c8a5e1545d5ed232d1dba30b3537d5088ef44a01881676ab75086608f296410
Sep 10 22:18:17.071974 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.071859    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9767e157_2180_4cf2_adaa_224044d181f6.slice/crio-4ef2c923171555519d7b9f1381b664066245dcf96ab5972e4f4cc40443260722 WatchSource:0}: Error finding container 4ef2c923171555519d7b9f1381b664066245dcf96ab5972e4f4cc40443260722: Status 404 returned error can't find the container with id 4ef2c923171555519d7b9f1381b664066245dcf96ab5972e4f4cc40443260722
Sep 10 22:18:17.073927 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.073900    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6335c6fe_ec20_4ff0_b57a_96b443a0fd88.slice/crio-cdd83ead5bb4f0715e1c10a6f3f25544fbd3dda7b67d25fcaf101dbbb94810a8 WatchSource:0}: Error finding container cdd83ead5bb4f0715e1c10a6f3f25544fbd3dda7b67d25fcaf101dbbb94810a8: Status 404 returned error can't find the container with id cdd83ead5bb4f0715e1c10a6f3f25544fbd3dda7b67d25fcaf101dbbb94810a8
Sep 10 22:18:17.077593 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.077572    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810b0ce6_ea16_4e7c_8d90_60b8d02dc7d7.slice/crio-a1a59d9410aa7c29c2585c441a4ce399df805177e1006aeff6dc47d952820873 WatchSource:0}: Error finding container a1a59d9410aa7c29c2585c441a4ce399df805177e1006aeff6dc47d952820873: Status 404 returned error can't find the container with id a1a59d9410aa7c29c2585c441a4ce399df805177e1006aeff6dc47d952820873
Sep 10 22:18:17.078410 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.078380    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2dd735_fe88_43be_babd_473a22a673a9.slice/crio-a26d8eaef7c4702a2e12ad3881ae2042cea4095b64b8d742a17dcd33f40b5a09 WatchSource:0}: Error finding container a26d8eaef7c4702a2e12ad3881ae2042cea4095b64b8d742a17dcd33f40b5a09: Status 404 returned error can't find the container with id a26d8eaef7c4702a2e12ad3881ae2042cea4095b64b8d742a17dcd33f40b5a09
Sep 10 22:18:17.079804 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:17.079784    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73556dbc_5492_42c9_a631_d8eb6c50d08c.slice/crio-8c09e02e99899b0709d7fbe9ff89b89511b83fc726caad6c85eaef8289c15f05 WatchSource:0}: Error finding container 8c09e02e99899b0709d7fbe9ff89b89511b83fc726caad6c85eaef8289c15f05: Status 404 returned error can't find the container with id 8c09e02e99899b0709d7fbe9ff89b89511b83fc726caad6c85eaef8289c15f05
Sep 10 22:18:17.385260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.385233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:17.385356 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.385268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:17.385407 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385388    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:17.385445 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385408    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:17.385445 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385424    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:17.385445 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385433    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:17.385445 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385442    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:19.38542655 +0000 UTC m=+5.969503569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:17.385625 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.385471    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:19.385460118 +0000 UTC m=+5.969537136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:17.485643 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.485604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:17.485804 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.485767    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:17.485854 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.485836    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:19.485816075 +0000 UTC m=+6.069893112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:17.811443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.811326    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:13:16 +0000 UTC" deadline="2028-02-06 04:13:21.65748593 +0000 UTC"
Sep 10 22:18:17.811443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.811369    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12317h55m3.846121926s"
Sep 10 22:18:17.889306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.888352    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:17.889306 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.888497    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:17.889306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.888904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:17.889306 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:17.889003    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:17.909645 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.909572    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k5kd" event={"ID":"73556dbc-5492-42c9-a631-d8eb6c50d08c","Type":"ContainerStarted","Data":"8c09e02e99899b0709d7fbe9ff89b89511b83fc726caad6c85eaef8289c15f05"}
Sep 10 22:18:17.922328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.922246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h5z8r" event={"ID":"ee2dd735-fe88-43be-babd-473a22a673a9","Type":"ContainerStarted","Data":"a26d8eaef7c4702a2e12ad3881ae2042cea4095b64b8d742a17dcd33f40b5a09"}
Sep 10 22:18:17.943669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.943636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4nzqz" event={"ID":"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6","Type":"ContainerStarted","Data":"5c8a5e1545d5ed232d1dba30b3537d5088ef44a01881676ab75086608f296410"}
Sep 10 22:18:17.967284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.967256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nppsj" event={"ID":"9767e157-2180-4cf2-adaa-224044d181f6","Type":"ContainerStarted","Data":"4ef2c923171555519d7b9f1381b664066245dcf96ab5972e4f4cc40443260722"}
Sep 10 22:18:17.990074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.989958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gnmw7" event={"ID":"b6a278a5-3036-4c64-a636-0752c2354cd2","Type":"ContainerStarted","Data":"00b823b7e55ac6d1cbfa31e7f4d3e73fa530333133e4b784cb7abe3c737e8363"}
Sep 10 22:18:17.999449 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:17.998791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" event={"ID":"843de8051e5b09f0a1842ff02cf35f50","Type":"ContainerStarted","Data":"1336b48d4dbaee2c7bbfa9914f341681df688576d6dc2afedd894266f9c7cae3"}
Sep 10 22:18:18.014879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.014805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerStarted","Data":"19fda277b06d520989a4125425ed84dc4e908bb17e812f3e3d81ad7c2a756c93"}
Sep 10 22:18:18.019592 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.018993    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-64.ec2.internal" podStartSLOduration=3.018976199 podStartE2EDuration="3.018976199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:18.018263234 +0000 UTC m=+4.602340274" watchObservedRunningTime="2026-09-10 22:18:18.018976199 +0000 UTC m=+4.603053245"
Sep 10 22:18:18.025837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.025536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx" event={"ID":"5eaf4be1-2e47-454b-b351-f46c542f644a","Type":"ContainerStarted","Data":"8f83d29d2c20249a56e957226be8dc6cc0041fa91b549eae28584bd87bab05bd"}
Sep 10 22:18:18.035532 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.035493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swvxp" event={"ID":"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7","Type":"ContainerStarted","Data":"a1a59d9410aa7c29c2585c441a4ce399df805177e1006aeff6dc47d952820873"}
Sep 10 22:18:18.044219 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.044120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"cdd83ead5bb4f0715e1c10a6f3f25544fbd3dda7b67d25fcaf101dbbb94810a8"}
Sep 10 22:18:18.063055 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.062990    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b4b02dd24e9af8850a0a47d5c9d4df8" containerID="4d886daf17afb0c76da924e68d7dceed92df3283da88d20beffc4931d01d0911" exitCode=0
Sep 10 22:18:18.063055 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.063029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"2b4b02dd24e9af8850a0a47d5c9d4df8","Type":"ContainerDied","Data":"4d886daf17afb0c76da924e68d7dceed92df3283da88d20beffc4931d01d0911"}
Sep 10 22:18:18.885367 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:18.885336    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:18.885832 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:18.885479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:19.089727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.089648    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" event={"ID":"2b4b02dd24e9af8850a0a47d5c9d4df8","Type":"ContainerStarted","Data":"19b9a48b26c60cc8fc22b878e9636b6e7069d151b3d7613550577f205bd73336"}
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.404028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.404083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404228    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404252    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404265    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404322    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.404301389 +0000 UTC m=+9.988378423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404396    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:19.404783 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.404431    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.404418697 +0000 UTC m=+9.988495732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:19.505017 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.504425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:19.505017 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.504611    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:19.505017 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.504675    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.504655 +0000 UTC m=+10.088732027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:19.886940 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.886860    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:19.887476 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.887018    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:19.887548 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:19.887509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:19.887752 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:19.887629    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:20.885412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:20.884925    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:20.885412 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:20.885053    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:21.887398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:21.886627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:21.887398 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:21.886767    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:21.887398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:21.887228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:21.887398 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:21.887394    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:22.885748 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:22.885639    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:22.885910 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:22.885782    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:23.441002 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:23.440960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:23.441661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:23.441029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:23.441661 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441212    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:23.441661 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441232    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:23.441661 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441247    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:23.441661 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441314    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:31.44129118 +0000 UTC m=+18.025368224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:23.442001 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441722    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:23.442001 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.441800    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:31.441783155 +0000 UTC m=+18.025860179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:23.542017 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:23.541983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:23.542210 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.542172    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:23.542284 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.542264    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:31.542242557 +0000 UTC m=+18.126319579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:23.886994 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:23.886913    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:23.887164 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.887033    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:23.887453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:23.887433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:23.887582 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:23.887540    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:24.885838 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:24.885315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:24.885838 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:24.885470    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:25.885536 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:25.885453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:25.885686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:25.885453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:25.885686 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:25.885627    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:25.885686 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:25.885665    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:26.885105 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:26.885075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:26.885594 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:26.885195    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:27.885260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:27.885229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:27.885701 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:27.885398    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:27.885701 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:27.885435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:27.885701 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:27.885519    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:28.885415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:28.885375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:28.885836 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:28.885521    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:29.885484 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:29.885441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:29.885910 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:29.885585    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:29.885910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:29.885654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:29.886128 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:29.886094    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:30.885169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:30.885134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:30.885390 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:30.885265    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:31.500895 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:31.500857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:31.500911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501025    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501039    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501055    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501066    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501100    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:47.501077637 +0000 UTC m=+34.085154681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:31.501434 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.501154    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:47.501143477 +0000 UTC m=+34.085220498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:31.601397 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:31.601362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:31.601551 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.601500    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:31.601617 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.601569    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:18:47.601551734 +0000 UTC m=+34.185628770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:31.885587 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:31.885559    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:31.885694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:31.885547    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:31.885694 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.885659    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:31.885823 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:31.885773    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:32.885445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:32.885416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:32.885874 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:32.885533    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:33.886038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:33.886005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:33.886433 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:33.886128    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:33.886433 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:33.886207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:33.886433 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:33.886325    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:34.885420 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:34.885386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:34.885594 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:34.885518    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:35.885912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:35.885440    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:35.886431 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:35.886028    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:35.886431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:35.885511    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:35.886431 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:35.886132    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:36.129747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.129668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gnmw7" event={"ID":"b6a278a5-3036-4c64-a636-0752c2354cd2","Type":"ContainerStarted","Data":"ec4935b1eb3a0796a5fbc10a06f052c52e9b032cd187510be140430072bf4530"}
Sep 10 22:18:36.131530 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.131484    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="a792707362d235572582efddd4e4d6bfde10e9e599fb3f5bb6cb02b9eb95ee65" exitCode=0
Sep 10 22:18:36.131662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.131581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"a792707362d235572582efddd4e4d6bfde10e9e599fb3f5bb6cb02b9eb95ee65"}
Sep 10 22:18:36.133340 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.133319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx" event={"ID":"5eaf4be1-2e47-454b-b351-f46c542f644a","Type":"ContainerStarted","Data":"f6de7813d55ffeca4be5f44bc5ecab177eb83c08e52ec39bde5a003df1897958"}
Sep 10 22:18:36.134970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.134947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swvxp" event={"ID":"810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7","Type":"ContainerStarted","Data":"b4b735aef898ed4f0c6f288f060a2faff8f8af427a8cea245178a98c4687528d"}
Sep 10 22:18:36.138444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138425    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"1969a9cafa90792e18f1fe18112543ec3e662aeeabfc7c77a7059545958efd2d"}
Sep 10 22:18:36.138562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"b659a78bc86072b03d06c18eab62cd7356a445895b987b29581111c41de23449"}
Sep 10 22:18:36.138627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"70fcba837816b250d873c9ee104fd736f97c1c8252cf4d5b21a3ba558e38f7cf"}
Sep 10 22:18:36.138627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138620    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"43e3e480ada5d01f7c4c812bf96bb2f7bb1bd1e0c7c98f499427bd18cdc6ad28"}
Sep 10 22:18:36.138733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138669    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"0f47b482f2d3497b5afdb90a54697882f9384b69dd24032550de4d8051412641"}
Sep 10 22:18:36.138733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.138717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"2fb7890dfe2d178a1fa497ac2ab0d26baf7d33656d98e3dd715ff494caa17a95"}
Sep 10 22:18:36.140053 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.140012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k5kd" event={"ID":"73556dbc-5492-42c9-a631-d8eb6c50d08c","Type":"ContainerStarted","Data":"aa479b45d28964c88ec2af97e101fb93f68df46a702529e3c2da5245d35e31e6"}
Sep 10 22:18:36.141705 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.141682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h5z8r" event={"ID":"ee2dd735-fe88-43be-babd-473a22a673a9","Type":"ContainerStarted","Data":"84c957eb3ba14acddd1239433c3a2def74aab8aab88f1176182b424adcb1a73a"}
Sep 10 22:18:36.143334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.143297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4nzqz" event={"ID":"6dc0fe57-4546-42c2-87ba-4b26d3dc56f6","Type":"ContainerStarted","Data":"4fd71576f54863b3307349f03fd49501bad897ae88dd57885113928bbc4514ba"}
Sep 10 22:18:36.145000 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.144956    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gnmw7" podStartSLOduration=4.045902107 podStartE2EDuration="22.144941377s" totalImagesPullingTime="18.09903927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:36.144680012 +0000 UTC m=+22.728757052" watchObservedRunningTime="2026-09-10 22:18:36.144941377 +0000 UTC m=+22.729018415"
Sep 10 22:18:36.145108 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.145049    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-64.ec2.internal" podStartSLOduration=21.145042851 podStartE2EDuration="21.145042851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:19.10698353 +0000 UTC m=+5.691060576" watchObservedRunningTime="2026-09-10 22:18:36.145042851 +0000 UTC m=+22.729119895"
Sep 10 22:18:36.162780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.162741    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h5z8r" podStartSLOduration=4.049175707 podStartE2EDuration="22.162729419s" totalImagesPullingTime="18.113553712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:36.162260956 +0000 UTC m=+22.746338001" watchObservedRunningTime="2026-09-10 22:18:36.162729419 +0000 UTC m=+22.746806458"
Sep 10 22:18:36.176088 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.176057    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-swvxp" podStartSLOduration=4.0831239010000004 podStartE2EDuration="22.17604581s" totalImagesPullingTime="18.092921909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:36.175785526 +0000 UTC m=+22.759862569" watchObservedRunningTime="2026-09-10 22:18:36.17604581 +0000 UTC m=+22.760122853"
Sep 10 22:18:36.192772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.192738    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4nzqz" podStartSLOduration=4.032041873 podStartE2EDuration="22.192725102s" totalImagesPullingTime="18.160683229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:36.192344129 +0000 UTC m=+22.776421170" watchObservedRunningTime="2026-09-10 22:18:36.192725102 +0000 UTC m=+22.776802162"
Sep 10 22:18:36.239129 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.239087    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9k5kd" podStartSLOduration=7.452314753 podStartE2EDuration="22.239072766s" totalImagesPullingTime="14.786758013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:36.23900849 +0000 UTC m=+22.823085529" watchObservedRunningTime="2026-09-10 22:18:36.239072766 +0000 UTC m=+22.823149806"
Sep 10 22:18:36.640682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.640659    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 22:18:36.819023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.818824    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T22:18:36.640675849Z","UUID":"87f36932-fd61-4443-939f-db2d1e09c273","Handler":null,"Name":"","Endpoint":""}
Sep 10 22:18:36.820843 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.820769    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 22:18:36.820843 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.820805    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 22:18:36.885305 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:36.885281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:36.885438 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:36.885382    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:37.147202 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:37.147125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nppsj" event={"ID":"9767e157-2180-4cf2-adaa-224044d181f6","Type":"ContainerStarted","Data":"4e4770027656320e307d10b564808eec2374561417ab3d15de994363fb3322f4"}
Sep 10 22:18:37.149184 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:37.149143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx" event={"ID":"5eaf4be1-2e47-454b-b351-f46c542f644a","Type":"ContainerStarted","Data":"fc030dfa24d2cbb936938fb796e6ee8f269141bae0c58ef453d5fbde93611057"}
Sep 10 22:18:37.885570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:37.885108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:37.885570 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:37.885240    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:37.885570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:37.885393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:37.885875 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:37.885703    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:38.153753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.153713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx" event={"ID":"5eaf4be1-2e47-454b-b351-f46c542f644a","Type":"ContainerStarted","Data":"d50668025a6a350e17664c81421c5000af584ce048d9a7b0077de021118c4770"}
Sep 10 22:18:38.158801 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.158734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"14005d9e611ff20dcfd72cd71d7d12ddca6057740a8a36a47470587537a328c8"}
Sep 10 22:18:38.171752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.171706    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nppsj" podStartSLOduration=6.077424639 podStartE2EDuration="24.171690869s" totalImagesPullingTime="18.09426623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:37.160878289 +0000 UTC m=+23.744955328" watchObservedRunningTime="2026-09-10 22:18:38.171690869 +0000 UTC m=+24.755767887"
Sep 10 22:18:38.172147 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.172125    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnlcx" podStartSLOduration=3.938945975 podStartE2EDuration="24.172116915s" totalImagesPullingTime="20.23317094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:38.170875655 +0000 UTC m=+24.754952694" watchObservedRunningTime="2026-09-10 22:18:38.172116915 +0000 UTC m=+24.756193955"
Sep 10 22:18:38.803452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.803421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:38.804132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.804109    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:38.885943 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:38.885922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:38.886063 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:38.886004    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:39.162721 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:39.162523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:39.163316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:39.162935    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9k5kd"
Sep 10 22:18:39.885662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:39.885630    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:39.885868 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:39.885677    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:39.885868 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:39.885801    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:39.886025 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:39.885888    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:40.168712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:40.168404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" event={"ID":"6335c6fe-ec20-4ff0-b57a-96b443a0fd88","Type":"ContainerStarted","Data":"405aa930def5d741298c1900e41f1e5d9cd7bd0cc10ad5475004bb46cc73a121"}
Sep 10 22:18:40.199627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:40.199578    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h" podStartSLOduration=8.043200446 podStartE2EDuration="26.199564529s" totalImagesPullingTime="18.156364083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:40.199254931 +0000 UTC m=+26.783331970" watchObservedRunningTime="2026-09-10 22:18:40.199564529 +0000 UTC m=+26.783641569"
Sep 10 22:18:40.885285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:40.885256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:40.885448 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:40.885353    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:41.171885 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.171813    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:41.172258 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.171892    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:41.172258 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.171932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:41.190468 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.190437    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:41.192735 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.192707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:18:41.885726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.885533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:41.885874 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:41.885800    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:41.885979 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.885638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:41.886103 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:41.886082    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:41.998078 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:41.998051    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kng8t"]
Sep 10 22:18:42.000719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.000699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvb2n"]
Sep 10 22:18:42.000844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.000808    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:42.000938 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:42.000912    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:42.001386 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.001358    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5kkst"]
Sep 10 22:18:42.175852 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.175828    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="66e2c9b26e0de992b2e6be87a831ad80773fdd8d4dc18cc607c55da998223d36" exitCode=0
Sep 10 22:18:42.176265 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.175922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"66e2c9b26e0de992b2e6be87a831ad80773fdd8d4dc18cc607c55da998223d36"}
Sep 10 22:18:42.176265 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.175951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:42.176265 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:42.175981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:42.176265 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:42.176089    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:42.176402 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:42.176292    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:43.885708 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:43.885676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:43.886229 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:43.885766    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:43.886229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:43.885780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:43.886229 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:43.885868    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:43.886229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:43.885891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:43.886229 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:43.885952    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:44.181860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:44.181770    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="d949375e181a57f514543752d01fcc9efbfac2a58262a64e9d4777188a8c20f7" exitCode=0
Sep 10 22:18:44.181860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:44.181834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"d949375e181a57f514543752d01fcc9efbfac2a58262a64e9d4777188a8c20f7"}
Sep 10 22:18:45.186890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:45.186738    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="3bf10be383d4392c037e118963a3a959cb380c4fc0afafdfc530bbc2b1f76df6" exitCode=0
Sep 10 22:18:45.186890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:45.186806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"3bf10be383d4392c037e118963a3a959cb380c4fc0afafdfc530bbc2b1f76df6"}
Sep 10 22:18:45.885922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:45.885891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:45.885922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:45.885904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:45.886196 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:45.886070    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:45.886196 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:45.886124    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:45.886196 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:45.886141    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:45.886355 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:45.886235    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:47.521904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.521862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:47.521904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.521904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522009    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522028    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522042    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522051    2559 projected.go:196] Error preparing data for projected volume kube-api-access-blxns for pod openshift-network-diagnostics/network-check-target-kng8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522072    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret podName:36d2fc78-340f-4d22-961c-8e70b440d188 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:19.522057633 +0000 UTC m=+66.106134651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret") pod "global-pull-secret-syncer-bvb2n" (UID: "36d2fc78-340f-4d22-961c-8e70b440d188") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:47.522456 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.522090    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns podName:a0fa9421-b5b9-4071-84c3-dc49444ed579 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:19.522080376 +0000 UTC m=+66.106157404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-blxns" (UniqueName: "kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns") pod "network-check-target-kng8t" (UID: "a0fa9421-b5b9-4071-84c3-dc49444ed579") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:47.622653 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.622624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:47.622812 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.622794    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:47.622906 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.622857    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs podName:17154967-f5fb-4eb0-b868-97d01004afcb nodeName:}" failed. No retries permitted until 2026-09-10 22:19:19.622838364 +0000 UTC m=+66.206915401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs") pod "network-metrics-daemon-5kkst" (UID: "17154967-f5fb-4eb0-b868-97d01004afcb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:47.885229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.885202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:47.885229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.885215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:47.885383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:47.885214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:47.885383 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.885322    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvb2n" podUID="36d2fc78-340f-4d22-961c-8e70b440d188"
Sep 10 22:18:47.885383 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.885354    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5kkst" podUID="17154967-f5fb-4eb0-b868-97d01004afcb"
Sep 10 22:18:47.885477 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:47.885446    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kng8t" podUID="a0fa9421-b5b9-4071-84c3-dc49444ed579"
Sep 10 22:18:48.179719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.179683    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-64.ec2.internal" event="NodeReady"
Sep 10 22:18:48.179879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.179850    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 22:18:48.215101 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.215071    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:18:48.237249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.237220    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sk978"]
Sep 10 22:18:48.237416 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.237362    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.240951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.240853    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 22:18:48.241120 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.241073    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6vhns\""
Sep 10 22:18:48.241314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.241293    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 22:18:48.241412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.241293    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 22:18:48.247160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.246769    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 22:18:48.255380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.255358    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pt9xn"]
Sep 10 22:18:48.255524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.255475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.258332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.258091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 22:18:48.258332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.258130    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 22:18:48.258332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.258132    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bjgt9\""
Sep 10 22:18:48.277593 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.277575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:18:48.277684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.277603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk978"]
Sep 10 22:18:48.277684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.277626    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pt9xn"]
Sep 10 22:18:48.277780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.277687    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.280125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.280077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 22:18:48.280125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.280119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 22:18:48.280248 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.280172    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 22:18:48.280248 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.280119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fp646\""
Sep 10 22:18:48.326419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326539 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326539 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326541    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.326656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwjg7\" (UniqueName: \"kubernetes.io/projected/34414182-1fc7-4627-b943-95b7486bd141-kube-api-access-mwjg7\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.326784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34414182-1fc7-4627-b943-95b7486bd141-config-volume\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.326784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34414182-1fc7-4627-b943-95b7486bd141-tmp-dir\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.326784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwjk\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.326993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.326807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.427758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.427726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.427758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.427762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34414182-1fc7-4627-b943-95b7486bd141-tmp-dir\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.427987 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.427789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwjk\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.427980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c731fea4-c4c7-492b-98b6-edda7abde3e1-cert\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.428137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34414182-1fc7-4627-b943-95b7486bd141-tmp-dir\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xt4x\" (UniqueName: \"kubernetes.io/projected/c731fea4-c4c7-492b-98b6-edda7abde3e1-kube-api-access-5xt4x\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.428185    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.428203    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.428299 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.428260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:48.928240664 +0000 UTC m=+35.512317705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:18:48.428569 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.428569 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwjg7\" (UniqueName: \"kubernetes.io/projected/34414182-1fc7-4627-b943-95b7486bd141-kube-api-access-mwjg7\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.428569 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.428371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34414182-1fc7-4627-b943-95b7486bd141-config-volume\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.428987 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.428753    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:48.429116 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.429026    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:48.929008456 +0000 UTC m=+35.513085492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:48.429231 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.429206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.429231 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.429216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34414182-1fc7-4627-b943-95b7486bd141-config-volume\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.429388 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.429369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.429439 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.429394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.434160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.434135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.434725 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.434702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.436673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.436645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.436946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.436900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwjk\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.438137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.438115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwjg7\" (UniqueName: \"kubernetes.io/projected/34414182-1fc7-4627-b943-95b7486bd141-kube-api-access-mwjg7\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.530702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.530626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c731fea4-c4c7-492b-98b6-edda7abde3e1-cert\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.530702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.530668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xt4x\" (UniqueName: \"kubernetes.io/projected/c731fea4-c4c7-492b-98b6-edda7abde3e1-kube-api-access-5xt4x\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.533180 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.533148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c731fea4-c4c7-492b-98b6-edda7abde3e1-cert\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.538855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.538835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xt4x\" (UniqueName: \"kubernetes.io/projected/c731fea4-c4c7-492b-98b6-edda7abde3e1-kube-api-access-5xt4x\") pod \"ingress-canary-pt9xn\" (UID: \"c731fea4-c4c7-492b-98b6-edda7abde3e1\") " pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.586972 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.586936    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pt9xn"
Sep 10 22:18:48.935093 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.935057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:48.935228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:48.935212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:48.935288 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.935222    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:48.935337 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.935307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:49.935286216 +0000 UTC m=+36.519363257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:48.935337 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.935322    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:18:48.935337 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.935336    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:18:48.935459 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:48.935384    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:49.93536764 +0000 UTC m=+36.519444663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:18:49.718473 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.718411    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pt9xn"]
Sep 10 22:18:49.805276 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:18:49.805249    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc731fea4_c4c7_492b_98b6_edda7abde3e1.slice/crio-84f19dced12fce5eee1a29034f18657317450867037ed4c9410ad677da5238c7 WatchSource:0}: Error finding container 84f19dced12fce5eee1a29034f18657317450867037ed4c9410ad677da5238c7: Status 404 returned error can't find the container with id 84f19dced12fce5eee1a29034f18657317450867037ed4c9410ad677da5238c7
Sep 10 22:18:49.889379 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.889357    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:18:49.889509 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.889445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:18:49.889689 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.889676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:18:49.893024 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.892978    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sd8gj\""
Sep 10 22:18:49.893024 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.893004    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:18:49.893172 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.893030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rw4f\""
Sep 10 22:18:49.893172 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.892988    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:18:49.893172 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.892984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:18:49.893172 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.893039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:18:49.945088 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.944959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:49.945186 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:49.945113    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:18:49.945186 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:49.945130    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:18:49.945288 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:49.945186    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:51.945166973 +0000 UTC m=+38.529244009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:18:49.945288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:49.945130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:49.945288 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:49.945201    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:49.945288 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:49.945240    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:51.945230342 +0000 UTC m=+38.529307396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:50.199109 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:50.199073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pt9xn" event={"ID":"c731fea4-c4c7-492b-98b6-edda7abde3e1","Type":"ContainerStarted","Data":"84f19dced12fce5eee1a29034f18657317450867037ed4c9410ad677da5238c7"}
Sep 10 22:18:50.201594 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:50.201570    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="c5634404df6a72e6bbdc3850d16e68ba53c005b67eff3724ffa5ab38eb4b0813" exitCode=0
Sep 10 22:18:50.201674 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:50.201616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"c5634404df6a72e6bbdc3850d16e68ba53c005b67eff3724ffa5ab38eb4b0813"}
Sep 10 22:18:51.208223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:51.208189    2559 generic.go:356] "Generic (PLEG): container finished" podID="ccddfa35-ccf0-4c08-a2d5-3ed840100cac" containerID="5c10013d780ea3861aad5e3b0b5c9ceb7948b65cd392483e4e9ef3e3dc4f3efa" exitCode=0
Sep 10 22:18:51.208633 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:51.208253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerDied","Data":"5c10013d780ea3861aad5e3b0b5c9ceb7948b65cd392483e4e9ef3e3dc4f3efa"}
Sep 10 22:18:51.960192 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:51.960111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:51.960192 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:51.960182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:51.960403 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:51.960271    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:51.960403 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:51.960299    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:18:51.960403 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:51.960312    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:18:51.960403 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:51.960334    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:55.960318048 +0000 UTC m=+42.544395090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:51.960403 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:51.960358    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:55.960343936 +0000 UTC m=+42.544420968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:18:52.214032 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:52.213970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84hxt" event={"ID":"ccddfa35-ccf0-4c08-a2d5-3ed840100cac","Type":"ContainerStarted","Data":"a5665abe933d53d1f2daf94da2e964519584f520df6ad4b7d2f0715331a1e536"}
Sep 10 22:18:52.236104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:52.235836    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-84hxt" podStartSLOduration=7.970153769 podStartE2EDuration="38.235817871s" totalImagesPullingTime="30.265664102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:52.234247031 +0000 UTC m=+38.818324070" watchObservedRunningTime="2026-09-10 22:18:52.235817871 +0000 UTC m=+38.819894912"
Sep 10 22:18:52.381311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:52.381286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:52.472184 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:52.472105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:52.572902 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:52.572860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:53.217453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:53.217420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pt9xn" event={"ID":"c731fea4-c4c7-492b-98b6-edda7abde3e1","Type":"ContainerStarted","Data":"98622499ee283ba53a0f53d771980de334fe6b769f07b8b2c646189348890be0"}
Sep 10 22:18:53.232837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:53.232795    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pt9xn" podStartSLOduration=2.7027116209999997 podStartE2EDuration="5.232779741s" totalImagesPullingTime="2.53006812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:53.231820757 +0000 UTC m=+39.815897797" watchObservedRunningTime="2026-09-10 22:18:53.232779741 +0000 UTC m=+39.816856781"
Sep 10 22:18:53.609815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:53.609742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:53.677442 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:53.677403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:55.992301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:55.992268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:55.992317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:55.992403    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:55.992415    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:55.992456    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:03.992442678 +0000 UTC m=+50.576519712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:55.992401    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:55.992662 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:55.992484    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:03.992478381 +0000 UTC m=+50.576555399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:57.274431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.274392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.331646 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.331616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.414975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.414935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.517703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.517679    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.615391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.615335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.867668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.867597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:57.959667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:57.959637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:58.111734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.111683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:58.118983 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.118935    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mxbgq"]
Sep 10 22:18:58.163736 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.163706    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxbgq"]
Sep 10 22:18:58.163822 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.163801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.166130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.166110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27trn\""
Sep 10 22:18:58.166270 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.166254    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 22:18:58.166366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.166350    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 22:18:58.166407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.166363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 22:18:58.166407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.166378    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 22:18:58.188138 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.188115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:58.307041 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.307012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.307415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.307052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e8353a-a0b4-4e31-9c4a-f7ec241025db-crio-socket\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.307415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.307131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.307415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.307209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lgc\" (UniqueName: \"kubernetes.io/projected/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-api-access-d6lgc\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.307415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.307258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e8353a-a0b4-4e31-9c4a-f7ec241025db-data-volume\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.407992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e8353a-a0b4-4e31-9c4a-f7ec241025db-crio-socket\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.408126    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.408141    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.408185    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:18:58.90816789 +0000 UTC m=+45.492244928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.408208    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:18:58.908202286 +0000 UTC m=+45.492279304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lgc\" (UniqueName: \"kubernetes.io/projected/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-api-access-d6lgc\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408247    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e8353a-a0b4-4e31-9c4a-f7ec241025db-crio-socket\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e8353a-a0b4-4e31-9c4a-f7ec241025db-data-volume\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.408689 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.408562    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e8353a-a0b4-4e31-9c4a-f7ec241025db-data-volume\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.417092 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.417066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lgc\" (UniqueName: \"kubernetes.io/projected/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-api-access-d6lgc\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.873298 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.873268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:58.912012 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.911986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.912150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.912048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:58.912150 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.912126    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.912242 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.912152    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.912242 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.912182    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:18:59.912168143 +0000 UTC m=+46.496245160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.912242 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:58.912204    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:18:59.912188974 +0000 UTC m=+46.496266019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.925747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:58.925726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.225748 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.225717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.281763 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.281734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.377260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.377236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.435404 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.435380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.752933 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.752902    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b9ghx"]
Sep 10 22:18:59.767070 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.767048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b9ghx"]
Sep 10 22:18:59.767169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.767132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:18:59.771633 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.771612    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 22:18:59.771770 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.771665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tv6pl\""
Sep 10 22:18:59.772351 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.772330    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 22:18:59.772447 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.772357    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 22:18:59.772447 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.772412    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 22:18:59.786947 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.786918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.887552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.887524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:18:59.918655 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.918630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-cabundle\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:18:59.918732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.918663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twf9f\" (UniqueName: \"kubernetes.io/projected/1d370c89-18f2-4527-9bb2-243d26cc9adc-kube-api-access-twf9f\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:18:59.918732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.918683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:59.918819 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.918753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:18:59.918819 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:59.918774    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:59.918819 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:18:59.918781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-key\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:18:59.918819 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:59.918814    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:01.91880195 +0000 UTC m=+48.502878987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:59.919002 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:59.918837    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:59.919002 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:18:59.918881    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:01.918869606 +0000 UTC m=+48.502946628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : configmap "kube-rbac-proxy" not found
Sep 10 22:19:00.020072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.020002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-key\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.020160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.020074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-cabundle\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.020160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.020102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twf9f\" (UniqueName: \"kubernetes.io/projected/1d370c89-18f2-4527-9bb2-243d26cc9adc-kube-api-access-twf9f\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.020804 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.020785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-cabundle\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.022338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.022317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1d370c89-18f2-4527-9bb2-243d26cc9adc-signing-key\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.040754 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.040733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twf9f\" (UniqueName: \"kubernetes.io/projected/1d370c89-18f2-4527-9bb2-243d26cc9adc-kube-api-access-twf9f\") pod \"service-ca-568869fdc5-b9ghx\" (UID: \"1d370c89-18f2-4527-9bb2-243d26cc9adc\") " pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.062723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.062699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gnmw7_b6a278a5-3036-4c64-a636-0752c2354cd2/dns-node-resolver/0.log"
Sep 10 22:19:00.077853 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.077830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-b9ghx"
Sep 10 22:19:00.373876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.373796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-b9ghx"]
Sep 10 22:19:00.377093 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:00.377067    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d370c89_18f2_4527_9bb2_243d26cc9adc.slice/crio-4b2edc0a3b5f96a89a33813d6a8a7ecd91c4ecad4ac4d17dc7fde128f57dd6f5 WatchSource:0}: Error finding container 4b2edc0a3b5f96a89a33813d6a8a7ecd91c4ecad4ac4d17dc7fde128f57dd6f5: Status 404 returned error can't find the container with id 4b2edc0a3b5f96a89a33813d6a8a7ecd91c4ecad4ac4d17dc7fde128f57dd6f5
Sep 10 22:19:00.750951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:00.750921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:01.235781 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:01.235745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-b9ghx" event={"ID":"1d370c89-18f2-4527-9bb2-243d26cc9adc","Type":"ContainerStarted","Data":"4b2edc0a3b5f96a89a33813d6a8a7ecd91c4ecad4ac4d17dc7fde128f57dd6f5"}
Sep 10 22:19:01.262992 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:01.262966    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-swvxp_810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7/node-ca/0.log"
Sep 10 22:19:01.936618 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:01.936588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:01.936965 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:01.936641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:01.936965 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:01.936732    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:01.936965 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:01.936789    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:05.936775217 +0000 UTC m=+52.520852261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:01.936965 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:01.936792    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:19:01.936965 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:01.936846    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:05.936830472 +0000 UTC m=+52.520907520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : configmap "kube-rbac-proxy" not found
Sep 10 22:19:02.062794 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:02.062764    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pt9xn_c731fea4-c4c7-492b-98b6-edda7abde3e1/serve-healthcheck-canary/0.log"
Sep 10 22:19:03.242260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:03.242233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-b9ghx" event={"ID":"1d370c89-18f2-4527-9bb2-243d26cc9adc","Type":"ContainerStarted","Data":"c443b8f51615b5f4cb82ff0f78c9ca034742cc79eb7e15f0659a688d98a2c355"}
Sep 10 22:19:03.259772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:03.259666    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-b9ghx" podStartSLOduration=1.837023255 podStartE2EDuration="4.259649011s" totalImagesPullingTime="2.422625756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:03.259231251 +0000 UTC m=+49.843308292" watchObservedRunningTime="2026-09-10 22:19:03.259649011 +0000 UTC m=+49.843726053"
Sep 10 22:19:03.797497 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:03.797442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.051469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.051377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:04.051469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.051460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:04.051687 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:04.051550    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:19:04.051687 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:04.051627    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls podName:34414182-1fc7-4627-b943-95b7486bd141 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:20.05160945 +0000 UTC m=+66.635686488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls") pod "dns-default-sk978" (UID: "34414182-1fc7-4627-b943-95b7486bd141") : secret "dns-default-metrics-tls" not found
Sep 10 22:19:04.051777 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:04.051693    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 22:19:04.051777 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:04.051724    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-558d44c5df-8ng86: secret "image-registry-tls" not found
Sep 10 22:19:04.051870 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:04.051823    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls podName:96beb033-6c95-4f8e-9445-bd9cbaf6e146 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:20.051799105 +0000 UTC m=+66.635876146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls") pod "image-registry-558d44c5df-8ng86" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146") : secret "image-registry-tls" not found
Sep 10 22:19:04.165509 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.165443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.316421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.316333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.560353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.560317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.660673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.660602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.761554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.761530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:04.877381 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:04.877310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:05.708959 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:05.708924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:05.966614 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:05.966545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:05.966614 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:05.966593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:05.966775 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:05.966673    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:19:05.966775 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:05.966704    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:05.966775 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:05.966720    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:13.966708355 +0000 UTC m=+60.550785386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : configmap "kube-rbac-proxy" not found
Sep 10 22:19:05.966775 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:19:05.966761    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls podName:02e8353a-a0b4-4e31-9c4a-f7ec241025db nodeName:}" failed. No retries permitted until 2026-09-10 22:19:13.966744412 +0000 UTC m=+60.550821433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mxbgq" (UID: "02e8353a-a0b4-4e31-9c4a-f7ec241025db") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:06.271931 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:06.271856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:06.462627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:06.462594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:06.661965 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:06.661878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:06.859957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:06.859927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.131638 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:07.131611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.768062 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:07.768033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.868877 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:07.868847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:07.925758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:07.925724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.255710 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:08.255671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.461362 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:08.461331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.655639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:08.655564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:08.711800 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:08.711773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:09.053046 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:09.053015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:09.886796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:09.886750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.255910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:10.255884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.356832 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:10.356801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.457693 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:10.457665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:10.653624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:10.653549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.013606 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:11.013574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.115050 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:11.115014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.662469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:11.662437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:11.856988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:11.856961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:12.257657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:12.257622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:12.859203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:12.859175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:13.188587 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:13.188510    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pzf6h"
Sep 10 22:19:13.276617 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:13.276582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:13.661135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:13.661102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:13.854340 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:13.854307    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.024075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.024036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:14.024534 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.024164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:14.024696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.024671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e8353a-a0b4-4e31-9c4a-f7ec241025db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:14.026315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.026297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e8353a-a0b4-4e31-9c4a-f7ec241025db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mxbgq\" (UID: \"02e8353a-a0b4-4e31-9c4a-f7ec241025db\") " pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:14.074231 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.074211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27trn\""
Sep 10 22:19:14.082209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.082195    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mxbgq"
Sep 10 22:19:14.258191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.258155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.375459 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.375405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mxbgq"]
Sep 10 22:19:14.378335 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:14.378313    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e8353a_a0b4_4e31_9c4a_f7ec241025db.slice/crio-641cbcdc04993ca3c8cce0b93954699a244004c4c438d68637f0257f099102bd WatchSource:0}: Error finding container 641cbcdc04993ca3c8cce0b93954699a244004c4c438d68637f0257f099102bd: Status 404 returned error can't find the container with id 641cbcdc04993ca3c8cce0b93954699a244004c4c438d68637f0257f099102bd
Sep 10 22:19:14.658194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.658129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:14.857563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:14.857535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:15.273041 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:15.273015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxbgq" event={"ID":"02e8353a-a0b4-4e31-9c4a-f7ec241025db","Type":"ContainerStarted","Data":"8941e798ea4f0896aaefe85a3b28a5906bdbf01361f59bb7081077e5e26b375c"}
Sep 10 22:19:15.273319 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:15.273079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxbgq" event={"ID":"02e8353a-a0b4-4e31-9c4a-f7ec241025db","Type":"ContainerStarted","Data":"641cbcdc04993ca3c8cce0b93954699a244004c4c438d68637f0257f099102bd"}
Sep 10 22:19:16.277828 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:16.277792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxbgq" event={"ID":"02e8353a-a0b4-4e31-9c4a-f7ec241025db","Type":"ContainerStarted","Data":"59f64af7bd0c6e6d62255d2d0d6374f9d6da45a1f327a7fa80bef10aebe1dab1"}
Sep 10 22:19:17.282388 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:17.282354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mxbgq" event={"ID":"02e8353a-a0b4-4e31-9c4a-f7ec241025db","Type":"ContainerStarted","Data":"da3fb7d9668c0ce2374583f02db469509a56298222437919eadc88602c1a5e2c"}
Sep 10 22:19:17.304909 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:17.302838    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mxbgq" podStartSLOduration=17.241368567 podStartE2EDuration="19.30281953s" totalImagesPullingTime="2.061450963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:17.301828993 +0000 UTC m=+63.885906049" watchObservedRunningTime="2026-09-10 22:19:17.30281953 +0000 UTC m=+63.886896574"
Sep 10 22:19:19.317213 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.317164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.417058 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.417025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.477847 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.477817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.566730 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.566709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:19:19.566844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.566742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:19:19.571017 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.570971    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:19:19.571074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.571015    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:19:19.579723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.579697    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36d2fc78-340f-4d22-961c-8e70b440d188-original-pull-secret\") pod \"global-pull-secret-syncer-bvb2n\" (UID: \"36d2fc78-340f-4d22-961c-8e70b440d188\") " pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:19:19.580227 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.580213    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:19:19.590130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.590110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blxns\" (UniqueName: \"kubernetes.io/projected/a0fa9421-b5b9-4071-84c3-dc49444ed579-kube-api-access-blxns\") pod \"network-check-target-kng8t\" (UID: \"a0fa9421-b5b9-4071-84c3-dc49444ed579\") " pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:19:19.604095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.604077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sd8gj\""
Sep 10 22:19:19.613058 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.613030    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:19:19.630034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.630016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvb2n"
Sep 10 22:19:19.667370 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.667341    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:19:19.670674 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.670658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:19:19.680819 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.680605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17154967-f5fb-4eb0-b868-97d01004afcb-metrics-certs\") pod \"network-metrics-daemon-5kkst\" (UID: \"17154967-f5fb-4eb0-b868-97d01004afcb\") " pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:19:19.799173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.799147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.869843 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.869779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:19.881672 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.881649    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kng8t"]
Sep 10 22:19:19.884612 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:19.884591    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fa9421_b5b9_4071_84c3_dc49444ed579.slice/crio-14613f152e50b06a7054061db14fa28e3aa1df493773439a6816f6ca4a1d5535 WatchSource:0}: Error finding container 14613f152e50b06a7054061db14fa28e3aa1df493773439a6816f6ca4a1d5535: Status 404 returned error can't find the container with id 14613f152e50b06a7054061db14fa28e3aa1df493773439a6816f6ca4a1d5535
Sep 10 22:19:19.902680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.902650    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvb2n"]
Sep 10 22:19:19.905697 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:19.905679    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d2fc78_340f_4d22_961c_8e70b440d188.slice/crio-42b8b1711b56bf1a49a43aedc4776f0848103fa9be715d5e1fea34056ab0a5c4 WatchSource:0}: Error finding container 42b8b1711b56bf1a49a43aedc4776f0848103fa9be715d5e1fea34056ab0a5c4: Status 404 returned error can't find the container with id 42b8b1711b56bf1a49a43aedc4776f0848103fa9be715d5e1fea34056ab0a5c4
Sep 10 22:19:19.910979 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.910963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rw4f\""
Sep 10 22:19:19.919132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.919099    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5kkst"
Sep 10 22:19:19.994628 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:19.994601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.066697 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.066673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.070637 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.070620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:20.070701 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.070661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:20.072723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.072704    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34414182-1fc7-4627-b943-95b7486bd141-metrics-tls\") pod \"dns-default-sk978\" (UID: \"34414182-1fc7-4627-b943-95b7486bd141\") " pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:20.072886 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.072869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"image-registry-558d44c5df-8ng86\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") " pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:20.196558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.196505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5kkst"]
Sep 10 22:19:20.199057 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:20.199035    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17154967_f5fb_4eb0_b868_97d01004afcb.slice/crio-12777b028766de5ebe93dd89f18041aa592a115b27d620bebbed976cbaa3552c WatchSource:0}: Error finding container 12777b028766de5ebe93dd89f18041aa592a115b27d620bebbed976cbaa3552c: Status 404 returned error can't find the container with id 12777b028766de5ebe93dd89f18041aa592a115b27d620bebbed976cbaa3552c
Sep 10 22:19:20.232962 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.232943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.290934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.290910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kng8t" event={"ID":"a0fa9421-b5b9-4071-84c3-dc49444ed579","Type":"ContainerStarted","Data":"14613f152e50b06a7054061db14fa28e3aa1df493773439a6816f6ca4a1d5535"}
Sep 10 22:19:20.292026 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.292009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvb2n" event={"ID":"36d2fc78-340f-4d22-961c-8e70b440d188","Type":"ContainerStarted","Data":"42b8b1711b56bf1a49a43aedc4776f0848103fa9be715d5e1fea34056ab0a5c4"}
Sep 10 22:19:20.293099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.293083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5kkst" event={"ID":"17154967-f5fb-4eb0-b868-97d01004afcb","Type":"ContainerStarted","Data":"12777b028766de5ebe93dd89f18041aa592a115b27d620bebbed976cbaa3552c"}
Sep 10 22:19:20.334803 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.334775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.352120 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.352104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6vhns\""
Sep 10 22:19:20.360125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.360108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:20.368299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.368279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bjgt9\""
Sep 10 22:19:20.376730 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.376701    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:20.435756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.435706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.503911 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.503833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:20.642705 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.642674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:19:20.646603 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:20.646574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96beb033_6c95_4f8e_9445_bd9cbaf6e146.slice/crio-6f58e771aa0d3f8e2a449f5e64f59c6ddfe34a0f396d07ea76fce43f52387adb WatchSource:0}: Error finding container 6f58e771aa0d3f8e2a449f5e64f59c6ddfe34a0f396d07ea76fce43f52387adb: Status 404 returned error can't find the container with id 6f58e771aa0d3f8e2a449f5e64f59c6ddfe34a0f396d07ea76fce43f52387adb
Sep 10 22:19:20.680401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:20.680380    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk978"]
Sep 10 22:19:20.687534 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:20.687508    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34414182_1fc7_4627_b943_95b7486bd141.slice/crio-2575571b93adb7dd71f45d435657bb03bca592105f0fa53edf49fecfae183659 WatchSource:0}: Error finding container 2575571b93adb7dd71f45d435657bb03bca592105f0fa53edf49fecfae183659: Status 404 returned error can't find the container with id 2575571b93adb7dd71f45d435657bb03bca592105f0fa53edf49fecfae183659
Sep 10 22:19:21.208884 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.208617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:21.305386 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.305351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" event={"ID":"96beb033-6c95-4f8e-9445-bd9cbaf6e146","Type":"ContainerStarted","Data":"81f54522e9c4431310431b7f92c0fd94af56f3f6682b7f9553369739c8bb77a9"}
Sep 10 22:19:21.305568 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.305414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" event={"ID":"96beb033-6c95-4f8e-9445-bd9cbaf6e146","Type":"ContainerStarted","Data":"6f58e771aa0d3f8e2a449f5e64f59c6ddfe34a0f396d07ea76fce43f52387adb"}
Sep 10 22:19:21.306191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.306169    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:21.309334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.309306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk978" event={"ID":"34414182-1fc7-4627-b943-95b7486bd141","Type":"ContainerStarted","Data":"2575571b93adb7dd71f45d435657bb03bca592105f0fa53edf49fecfae183659"}
Sep 10 22:19:21.331250 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.330415    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" podStartSLOduration=57.330394999 podStartE2EDuration="57.330394999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:21.329189947 +0000 UTC m=+67.913266989" watchObservedRunningTime="2026-09-10 22:19:21.330394999 +0000 UTC m=+67.914472040"
Sep 10 22:19:21.413063 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.412960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:21.494904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:21.494756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:22.315131 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.315047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5kkst" event={"ID":"17154967-f5fb-4eb0-b868-97d01004afcb","Type":"ContainerStarted","Data":"311c0af4bb66024786c5df72d58bc3d11357c9445a557dbd0c1550e681d1553c"}
Sep 10 22:19:22.468706 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.468648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:22.569664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.569583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:22.669691 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.669656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:22.806248 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.806215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:22.907166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:22.907089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:23.411014 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.410987    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"]
Sep 10 22:19:23.425750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.425724    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.429549 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.429523    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 22:19:23.430872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.430820    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 22:19:23.430872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.430822    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 22:19:23.431064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.430844    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 22:19:23.438694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.438674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"]
Sep 10 22:19:23.478378 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.478354    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:19:23.500135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.500107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-tmp\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.500276 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.500152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhf7\" (UniqueName: \"kubernetes.io/projected/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-kube-api-access-9jhf7\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.500276 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.500223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.534363 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.534339    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-cmpx8"]
Sep 10 22:19:23.551447 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.551424    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"]
Sep 10 22:19:23.551571 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.551544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:23.554832 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.554806    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 22:19:23.554942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.554840    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j2bhr\""
Sep 10 22:19:23.555500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.555471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 22:19:23.565635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.565618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-cmpx8"]
Sep 10 22:19:23.565726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.565707    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:23.571117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.571093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-456zb\""
Sep 10 22:19:23.577414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.577396    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 22:19:23.583748 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.583725    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"]
Sep 10 22:19:23.601094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6rrk\" (UniqueName: \"kubernetes.io/projected/baf88053-a688-4fe9-ae2a-a339eb146e6d-kube-api-access-x6rrk\") pod \"downloads-76f99584f4-cmpx8\" (UID: \"baf88053-a688-4fe9-ae2a-a339eb146e6d\") " pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:23.601203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-tmp\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.601203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhf7\" (UniqueName: \"kubernetes.io/projected/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-kube-api-access-9jhf7\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.601203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/349dc314-2f58-4321-a25c-acdb4515d596-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-k29mq\" (UID: \"349dc314-2f58-4321-a25c-acdb4515d596\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:23.601345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.601557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.601541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-tmp\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.603967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.603948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.628132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.628108    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-959988f94-nwq58"]
Sep 10 22:19:23.630255 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.630211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.630790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.630764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:23.650043 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.650025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhf7\" (UniqueName: \"kubernetes.io/projected/ccbe58c2-14cd-4fe8-8094-387eb7a86a8a-kube-api-access-9jhf7\") pod \"klusterlet-addon-workmgr-6d846fd679-p7pgl\" (UID: \"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.654762 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.654740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-959988f94-nwq58"]
Sep 10 22:19:23.702079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-installation-pull-secrets\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5sh\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-kube-api-access-6j5sh\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/349dc314-2f58-4321-a25c-acdb4515d596-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-k29mq\" (UID: \"349dc314-2f58-4321-a25c-acdb4515d596\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:23.702223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-bound-sa-token\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-trusted-ca\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-registry-tls\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6aebeac-98ed-4908-803c-fbbb48325059-ca-trust-extracted\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6rrk\" (UniqueName: \"kubernetes.io/projected/baf88053-a688-4fe9-ae2a-a339eb146e6d-kube-api-access-x6rrk\") pod \"downloads-76f99584f4-cmpx8\" (UID: \"baf88053-a688-4fe9-ae2a-a339eb146e6d\") " pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:23.702566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-registry-certificates\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.702566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.702440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-image-registry-private-configuration\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.705188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.705165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/349dc314-2f58-4321-a25c-acdb4515d596-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-k29mq\" (UID: \"349dc314-2f58-4321-a25c-acdb4515d596\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:23.730269 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.730227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6rrk\" (UniqueName: \"kubernetes.io/projected/baf88053-a688-4fe9-ae2a-a339eb146e6d-kube-api-access-x6rrk\") pod \"downloads-76f99584f4-cmpx8\" (UID: \"baf88053-a688-4fe9-ae2a-a339eb146e6d\") " pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:23.736448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.736427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:23.803724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-registry-certificates\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.803893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-image-registry-private-configuration\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.803893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-installation-pull-secrets\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.803893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5sh\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-kube-api-access-6j5sh\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.803893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-bound-sa-token\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.803893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-trusted-ca\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.804177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-registry-tls\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.804177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.803929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6aebeac-98ed-4908-803c-fbbb48325059-ca-trust-extracted\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.804285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.804242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6aebeac-98ed-4908-803c-fbbb48325059-ca-trust-extracted\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.804724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.804576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-registry-certificates\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.805278 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.805239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6aebeac-98ed-4908-803c-fbbb48325059-trusted-ca\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.806864 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.806833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-installation-pull-secrets\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.807007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.806982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6aebeac-98ed-4908-803c-fbbb48325059-image-registry-private-configuration\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.807072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.807057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-registry-tls\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.815816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.815789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-bound-sa-token\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.817785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.817769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5sh\" (UniqueName: \"kubernetes.io/projected/b6aebeac-98ed-4908-803c-fbbb48325059-kube-api-access-6j5sh\") pod \"image-registry-959988f94-nwq58\" (UID: \"b6aebeac-98ed-4908-803c-fbbb48325059\") " pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.829703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.829672    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:23.862387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.862341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:23.875078 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.875043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:23.939449 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.939424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:23.993913 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:23.993830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:24.093118 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:24.093080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:25.476117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:25.476080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"]
Sep 10 22:19:25.479246 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:25.479209    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbe58c2_14cd_4fe8_8094_387eb7a86a8a.slice/crio-a1f98809ddb32b31cd5f6edad1558574937f306d1e243d6082a7f46020836aac WatchSource:0}: Error finding container a1f98809ddb32b31cd5f6edad1558574937f306d1e243d6082a7f46020836aac: Status 404 returned error can't find the container with id a1f98809ddb32b31cd5f6edad1558574937f306d1e243d6082a7f46020836aac
Sep 10 22:19:25.481903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:25.481743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"]
Sep 10 22:19:25.486037 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:25.486018    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349dc314_2f58_4321_a25c_acdb4515d596.slice/crio-51e6139a477841e1963f4237fa4c3655853811e2780e4d2ed2e4ea0b17ae8587 WatchSource:0}: Error finding container 51e6139a477841e1963f4237fa4c3655853811e2780e4d2ed2e4ea0b17ae8587: Status 404 returned error can't find the container with id 51e6139a477841e1963f4237fa4c3655853811e2780e4d2ed2e4ea0b17ae8587
Sep 10 22:19:25.514285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:25.514263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-959988f94-nwq58"]
Sep 10 22:19:25.515942 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:25.515914    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6aebeac_98ed_4908_803c_fbbb48325059.slice/crio-c3043aa3bb5d899f5ae66b844f20808f48d379747575ffad56ae7e4ae7a56e46 WatchSource:0}: Error finding container c3043aa3bb5d899f5ae66b844f20808f48d379747575ffad56ae7e4ae7a56e46: Status 404 returned error can't find the container with id c3043aa3bb5d899f5ae66b844f20808f48d379747575ffad56ae7e4ae7a56e46
Sep 10 22:19:25.530529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:25.530461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-cmpx8"]
Sep 10 22:19:26.336698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.336660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kng8t" event={"ID":"a0fa9421-b5b9-4071-84c3-dc49444ed579","Type":"ContainerStarted","Data":"16e1a7238fe1a03f0542374b3fe77142afe0dfb3d751c148778d571cacd4fce6"}
Sep 10 22:19:26.336882 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.336767    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:19:26.338541 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.338513    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvb2n" event={"ID":"36d2fc78-340f-4d22-961c-8e70b440d188","Type":"ContainerStarted","Data":"76fd3bb4b84233b7785f2c69a62c4e79f9c8b125168c1205bf49b9e8e33469a1"}
Sep 10 22:19:26.340573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.340505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-959988f94-nwq58" event={"ID":"b6aebeac-98ed-4908-803c-fbbb48325059","Type":"ContainerStarted","Data":"85bf8700283c7c76416399b7379eb0bf2a4e727680306e0040d644cd363f55f2"}
Sep 10 22:19:26.340573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.340548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-959988f94-nwq58" event={"ID":"b6aebeac-98ed-4908-803c-fbbb48325059","Type":"ContainerStarted","Data":"c3043aa3bb5d899f5ae66b844f20808f48d379747575ffad56ae7e4ae7a56e46"}
Sep 10 22:19:26.340743 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.340583    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:26.343201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.343169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5kkst" event={"ID":"17154967-f5fb-4eb0-b868-97d01004afcb","Type":"ContainerStarted","Data":"020e18744c22ac41476a81c4d9fc74a84ace9e5a164e3f108b0cf5bf2d5e8eeb"}
Sep 10 22:19:26.345583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.345549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-cmpx8" event={"ID":"baf88053-a688-4fe9-ae2a-a339eb146e6d","Type":"ContainerStarted","Data":"cf27c77b167575378578a8ecd95657bf4309032493b69ec161f9db3e586fce80"}
Sep 10 22:19:26.346922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.346900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq" event={"ID":"349dc314-2f58-4321-a25c-acdb4515d596","Type":"ContainerStarted","Data":"51e6139a477841e1963f4237fa4c3655853811e2780e4d2ed2e4ea0b17ae8587"}
Sep 10 22:19:26.349268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.349240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk978" event={"ID":"34414182-1fc7-4627-b943-95b7486bd141","Type":"ContainerStarted","Data":"d1fc0905196d503762e020ef3e847f882ab58b482c79f18b7450d02f8098bbcf"}
Sep 10 22:19:26.349379 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.349289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk978" event={"ID":"34414182-1fc7-4627-b943-95b7486bd141","Type":"ContainerStarted","Data":"31a54a566d3c12462ca44fa5413ad48bb8f83bc4975c490764d6458f541530e1"}
Sep 10 22:19:26.349379 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.349318    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:26.350534 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.350512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl" event={"ID":"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a","Type":"ContainerStarted","Data":"a1f98809ddb32b31cd5f6edad1558574937f306d1e243d6082a7f46020836aac"}
Sep 10 22:19:26.354235 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.354032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kng8t" podStartSLOduration=67.040437062 podStartE2EDuration="1m12.354015058s" totalImagesPullingTime="5.313577996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:26.353674118 +0000 UTC m=+72.937751171" watchObservedRunningTime="2026-09-10 22:19:26.354015058 +0000 UTC m=+72.938092099"
Sep 10 22:19:26.374562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.374352    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sk978" podStartSLOduration=33.877524683 podStartE2EDuration="38.374331371s" totalImagesPullingTime="4.496806688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:26.372841289 +0000 UTC m=+72.956918330" watchObservedRunningTime="2026-09-10 22:19:26.374331371 +0000 UTC m=+72.958408412"
Sep 10 22:19:26.395784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.395709    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bvb2n" podStartSLOduration=67.086873265 podStartE2EDuration="1m12.395686425s" totalImagesPullingTime="5.30881316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:26.394562149 +0000 UTC m=+72.978639190" watchObservedRunningTime="2026-09-10 22:19:26.395686425 +0000 UTC m=+72.979763467"
Sep 10 22:19:26.419942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.419882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-959988f94-nwq58" podStartSLOduration=3.4198624 podStartE2EDuration="3.4198624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:26.417841349 +0000 UTC m=+73.001918390" watchObservedRunningTime="2026-09-10 22:19:26.4198624 +0000 UTC m=+73.003939439"
Sep 10 22:19:26.436415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.436154    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5kkst" podStartSLOduration=70.604007308 podStartE2EDuration="1m12.436131587s" totalImagesPullingTime="1.832124279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:26.435262815 +0000 UTC m=+73.019339856" watchObservedRunningTime="2026-09-10 22:19:26.436131587 +0000 UTC m=+73.020208671"
Sep 10 22:19:26.570821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.570771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:26.654988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:26.654929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:27.356688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:27.356634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq" event={"ID":"349dc314-2f58-4321-a25c-acdb4515d596","Type":"ContainerStarted","Data":"cadd13ab1b3c4cd168f29b006560f7340237c048992ab442325df53b13c26a96"}
Sep 10 22:19:27.373445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:27.373375    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq" podStartSLOduration=3.210481229 podStartE2EDuration="4.373360416s" totalImagesPullingTime="1.162879187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:27.371980534 +0000 UTC m=+73.956057574" watchObservedRunningTime="2026-09-10 22:19:27.373360416 +0000 UTC m=+73.957437455"
Sep 10 22:19:28.360740 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.360685    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:28.367064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.367035    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-k29mq"
Sep 10 22:19:28.649912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.649807    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:28.698383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.698348    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-mv792"]
Sep 10 22:19:28.701179 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.701150    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.703837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.703751    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 22:19:28.706480 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.706456    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 22:19:28.706673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.706627    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-d8mj5\""
Sep 10 22:19:28.707082 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.707059    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 22:19:28.707451 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.707433    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 22:19:28.707551 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.707473    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 22:19:28.716729 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.716705    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-mv792"]
Sep 10 22:19:28.746157 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.746115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.746331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.746175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxmw\" (UniqueName: \"kubernetes.io/projected/ae067254-1f0f-494c-b7ee-33760888dc6c-kube-api-access-4nxmw\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.746331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.746231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.746331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.746307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae067254-1f0f-494c-b7ee-33760888dc6c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.755139 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.755093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:28.847220 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.847181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.847407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.847234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxmw\" (UniqueName: \"kubernetes.io/projected/ae067254-1f0f-494c-b7ee-33760888dc6c-kube-api-access-4nxmw\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.847407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.847264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.847407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.847308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae067254-1f0f-494c-b7ee-33760888dc6c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.848144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.848118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae067254-1f0f-494c-b7ee-33760888dc6c-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.849928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.849909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.850048 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.850030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae067254-1f0f-494c-b7ee-33760888dc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.858574 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.858529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxmw\" (UniqueName: \"kubernetes.io/projected/ae067254-1f0f-494c-b7ee-33760888dc6c-kube-api-access-4nxmw\") pod \"prometheus-operator-68bcd7f987-mv792\" (UID: \"ae067254-1f0f-494c-b7ee-33760888dc6c\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:28.864681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:28.864646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:29.013770 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:29.013732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792"
Sep 10 22:19:29.293233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:29.293150    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-mv792"]
Sep 10 22:19:29.296326 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:29.296298    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae067254_1f0f_494c_b7ee_33760888dc6c.slice/crio-088acabdac562d46b209cfe3ab607950233cb8a81f24239a779ddd2919a90c0b WatchSource:0}: Error finding container 088acabdac562d46b209cfe3ab607950233cb8a81f24239a779ddd2919a90c0b: Status 404 returned error can't find the container with id 088acabdac562d46b209cfe3ab607950233cb8a81f24239a779ddd2919a90c0b
Sep 10 22:19:29.366256 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:29.366216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792" event={"ID":"ae067254-1f0f-494c-b7ee-33760888dc6c","Type":"ContainerStarted","Data":"088acabdac562d46b209cfe3ab607950233cb8a81f24239a779ddd2919a90c0b"}
Sep 10 22:19:30.126765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.126617    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:19:30.129012 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.128985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.132132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.131653    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 22:19:30.133334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.132986    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 22:19:30.133334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.133201    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 22:19:30.133334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.133225    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 22:19:30.133567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.133429    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 22:19:30.135447 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.133686    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zzpsp\""
Sep 10 22:19:30.147396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.147306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.261656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.260781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6whs\" (UniqueName: \"kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.361819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.361875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.361921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.361962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6whs\" (UniqueName: \"kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.362004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.362032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.362875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.362824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.363345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.362979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.363345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.363022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.375866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.375788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.376872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.376756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.379271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.379226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6whs\" (UniqueName: \"kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs\") pod \"console-79cf574847-6qgc5\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") " pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.445561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.445312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:30.536401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.536361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:30.633463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.633379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:30.696332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:30.696297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.553728 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:32.553659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:32.613074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:32.613031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:33.298048 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.297882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:19:33.303583 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:33.303557    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f52918_3f6b_4fce_b519_f17ce56f8d00.slice/crio-2187548a693a575ce39fa8636b4e7cdaec674a9304a7cf8075c032a22c8caf98 WatchSource:0}: Error finding container 2187548a693a575ce39fa8636b4e7cdaec674a9304a7cf8075c032a22c8caf98: Status 404 returned error can't find the container with id 2187548a693a575ce39fa8636b4e7cdaec674a9304a7cf8075c032a22c8caf98
Sep 10 22:19:33.344664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.344597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:33.388222 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.388179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl" event={"ID":"ccbe58c2-14cd-4fe8-8094-387eb7a86a8a","Type":"ContainerStarted","Data":"ef71a2018031ab8410ed5a0c33a0079af76d8bbcece18b3762ea3a400a992267"}
Sep 10 22:19:33.388523 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.388453    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:33.390596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.390572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl"
Sep 10 22:19:33.390767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.390742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792" event={"ID":"ae067254-1f0f-494c-b7ee-33760888dc6c","Type":"ContainerStarted","Data":"105fe53e82bc5fc7ae154d656dc9f14b0aad00aa14d9d0c88c4d73a8c707e60a"}
Sep 10 22:19:33.390859 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.390786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792" event={"ID":"ae067254-1f0f-494c-b7ee-33760888dc6c","Type":"ContainerStarted","Data":"bcb07dd3a9aa7f088bfc5c62db3a8702f36ba49de7b234e66fd3b3d1ee5760bc"}
Sep 10 22:19:33.392990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.392970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf574847-6qgc5" event={"ID":"26f52918-3f6b-4fce-b519-f17ce56f8d00","Type":"ContainerStarted","Data":"2187548a693a575ce39fa8636b4e7cdaec674a9304a7cf8075c032a22c8caf98"}
Sep 10 22:19:33.407934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.407274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d846fd679-p7pgl" podStartSLOduration=2.849553121 podStartE2EDuration="10.407252104s" totalImagesPullingTime="7.557698983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:33.406310148 +0000 UTC m=+79.990387187" watchObservedRunningTime="2026-09-10 22:19:33.407252104 +0000 UTC m=+79.991329147"
Sep 10 22:19:33.429299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:33.429213    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-mv792" podStartSLOduration=1.706964287 podStartE2EDuration="5.429190026s" totalImagesPullingTime="3.722225739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:33.428180675 +0000 UTC m=+80.012257715" watchObservedRunningTime="2026-09-10 22:19:33.429190026 +0000 UTC m=+80.013267087"
Sep 10 22:19:34.435855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:34.435811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:34.537034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:34.536985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:34.812680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:34.812551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.114905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.114797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.175620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.175231    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"]
Sep 10 22:19:35.178400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.178374    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.181996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.181622    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b5r7x\""
Sep 10 22:19:35.181996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.181729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:19:35.181996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.181897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 22:19:35.182606 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.182556    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 22:19:35.198509 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.197567    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hc6cz"]
Sep 10 22:19:35.200433 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.200412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.204484 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.204459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"]
Sep 10 22:19:35.207543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.207377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 22:19:35.207543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.207390    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 22:19:35.207543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.207516    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tmkzm\""
Sep 10 22:19:35.208441 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.207662    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 22:19:35.233238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.233199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.312081 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-wtmp\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-metrics-client-ca\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ca88908-8abd-4421-b1ff-7ca0490250ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4z9\" (UniqueName: \"kubernetes.io/projected/546c5848-3e75-4174-9aa7-0a3c17279075-kube-api-access-6q4z9\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312395    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-root\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-sys\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-tls\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86zz\" (UniqueName: \"kubernetes.io/projected/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-api-access-h86zz\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.312788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.312788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.312611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-textfile\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.326779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.326723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.414119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.414119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-root\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-sys\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-tls\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-root\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86zz\" (UniqueName: \"kubernetes.io/projected/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-api-access-h86zz\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.414352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-textfile\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-wtmp\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-metrics-client-ca\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ca88908-8abd-4421-b1ff-7ca0490250ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414547    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4z9\" (UniqueName: \"kubernetes.io/projected/546c5848-3e75-4174-9aa7-0a3c17279075-kube-api-access-6q4z9\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.414771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-sys\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.415145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ca88908-8abd-4421-b1ff-7ca0490250ff-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.415609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-wtmp\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415543    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-textfile\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.415609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.415563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ca88908-8abd-4421-b1ff-7ca0490250ff-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.416140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.416065    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-metrics-client-ca\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.416755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.416516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-accelerators-collector-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.418073 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.418027    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.418371 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.418325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.418663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.418624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/546c5848-3e75-4174-9aa7-0a3c17279075-node-exporter-tls\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.419659 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.419632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.434790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.434726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.437328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.437248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4z9\" (UniqueName: \"kubernetes.io/projected/546c5848-3e75-4174-9aa7-0a3c17279075-kube-api-access-6q4z9\") pod \"node-exporter-hc6cz\" (UID: \"546c5848-3e75-4174-9aa7-0a3c17279075\") " pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.437328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.437255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86zz\" (UniqueName: \"kubernetes.io/projected/4ca88908-8abd-4421-b1ff-7ca0490250ff-kube-api-access-h86zz\") pod \"kube-state-metrics-59fbdd77d-cr8t5\" (UID: \"4ca88908-8abd-4421-b1ff-7ca0490250ff\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.494533 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.494474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"
Sep 10 22:19:35.506236 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.506181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:35.520152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.520116    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hc6cz"
Sep 10 22:19:35.697590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:35.697509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.128733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:36.128692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.225090 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:36.224946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.360001 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:36.359959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sk978"
Sep 10 22:19:36.877167 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:36.877132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:36.977260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:36.977224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.078144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:37.077847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.410908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:37.410858    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.622133 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:37.622091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.682148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:37.682064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:37.977612 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:37.977577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:38.037457 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:38.037424    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:38.164878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:38.164840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:38.592436 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:38.592401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:39.303119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:39.303072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:39.404517 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:39.404438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:39.838367 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:39.838334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:39.936500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:39.936457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:40.482144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:40.482107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:41.292573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:41.292527    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:42.325648 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:42.325610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:42.425769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:42.425739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:43.047924 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.047887    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:19:43.107353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.107326    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:19:43.152612 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.152586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:19:43.152771 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.152672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.171538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.171516    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 22:19:43.287025 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.286994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.287461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.287255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4khk\" (UniqueName: \"kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388300 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388300 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388818 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388818 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388818 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4khk\" (UniqueName: \"kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388818 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.388818 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.388468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.389117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.389082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.389513 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.389254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.389740 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.389721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.390102 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.390076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.391140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.391119    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.391234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.391140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.401935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.401917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4khk\" (UniqueName: \"kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk\") pod \"console-7c4c87c6f4-5vwn4\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") " pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:43.462481 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:43.462451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:44.155644 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:44.155545    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546c5848_3e75_4174_9aa7_0a3c17279075.slice/crio-b38fb8a905368e6fb26624472f05d4983761a0b0540ee6be69abf3783a9da797 WatchSource:0}: Error finding container b38fb8a905368e6fb26624472f05d4983761a0b0540ee6be69abf3783a9da797: Status 404 returned error can't find the container with id b38fb8a905368e6fb26624472f05d4983761a0b0540ee6be69abf3783a9da797
Sep 10 22:19:44.329350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.329328    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:44.440003 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:44.439976    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b832215_e84e_49f1_bdbd_388e037924a8.slice/crio-0e2344de3209e394f1ebb403417480bf1dfbd8d6fecfb881f662473afa962fa5 WatchSource:0}: Error finding container 0e2344de3209e394f1ebb403417480bf1dfbd8d6fecfb881f662473afa962fa5: Status 404 returned error can't find the container with id 0e2344de3209e394f1ebb403417480bf1dfbd8d6fecfb881f662473afa962fa5
Sep 10 22:19:44.441069 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.441038    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:19:44.442343 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.442316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6cz" event={"ID":"546c5848-3e75-4174-9aa7-0a3c17279075","Type":"ContainerStarted","Data":"b38fb8a905368e6fb26624472f05d4983761a0b0540ee6be69abf3783a9da797"}
Sep 10 22:19:44.446958 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.446545    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5"]
Sep 10 22:19:44.447522 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.447477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-cmpx8" event={"ID":"baf88053-a688-4fe9-ae2a-a339eb146e6d","Type":"ContainerStarted","Data":"d4555c6f8172a8da7f0f542769e64535120048afd9c29a55d8e0c1c512d441d0"}
Sep 10 22:19:44.449344 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:19:44.449319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca88908_8abd_4421_b1ff_7ca0490250ff.slice/crio-aa4a03bdb5e2ede45fee6afa5b046b1c4bcb956952df0f7ab84106be171873ba WatchSource:0}: Error finding container aa4a03bdb5e2ede45fee6afa5b046b1c4bcb956952df0f7ab84106be171873ba: Status 404 returned error can't find the container with id aa4a03bdb5e2ede45fee6afa5b046b1c4bcb956952df0f7ab84106be171873ba
Sep 10 22:19:44.449694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.449585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf574847-6qgc5" event={"ID":"26f52918-3f6b-4fce-b519-f17ce56f8d00","Type":"ContainerStarted","Data":"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"}
Sep 10 22:19:44.465696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.465672    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:44.467151 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.467123    2559 patch_prober.go:28] interesting pod/downloads-76f99584f4-cmpx8 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body=
Sep 10 22:19:44.467246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.467175    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-cmpx8" podUID="baf88053-a688-4fe9-ae2a-a339eb146e6d" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused"
Sep 10 22:19:44.490444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.490399    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-cmpx8" podStartSLOduration=2.8131168090000003 podStartE2EDuration="21.490386807s" totalImagesPullingTime="18.677269998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:44.489803505 +0000 UTC m=+91.073880545" watchObservedRunningTime="2026-09-10 22:19:44.490386807 +0000 UTC m=+91.074463846"
Sep 10 22:19:44.526714 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:44.526674    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cf574847-6qgc5" podStartSLOduration=3.6758667259999998 podStartE2EDuration="14.526654752s" totalImagesPullingTime="10.850788026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:44.524802961 +0000 UTC m=+91.108880002" watchObservedRunningTime="2026-09-10 22:19:44.526654752 +0000 UTC m=+91.110731792"
Sep 10 22:19:45.112333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.112284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:45.146532 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.145261    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:19:45.184216 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.184092    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:19:45.184395 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.184235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.208072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.208002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:45.305880 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.305842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hn75\" (UniqueName: \"kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306050 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.305906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306050 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.305950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306050 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.306022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.306050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.306081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.306193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.306129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.406969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.406877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.406969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.406921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.406969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.406947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hn75\" (UniqueName: \"kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407676    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.407988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.408077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.408556 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.408292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.410221 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.410177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.411063 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.411022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.417141 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.417111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hn75\" (UniqueName: \"kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75\") pod \"console-57cf6dcdb-48xtr\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") " pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.455776 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.455741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4c87c6f4-5vwn4" event={"ID":"9b832215-e84e-49f1-bdbd-388e037924a8","Type":"ContainerStarted","Data":"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"}
Sep 10 22:19:45.456161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.455803    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4c87c6f4-5vwn4" event={"ID":"9b832215-e84e-49f1-bdbd-388e037924a8","Type":"ContainerStarted","Data":"0e2344de3209e394f1ebb403417480bf1dfbd8d6fecfb881f662473afa962fa5"}
Sep 10 22:19:45.457608 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.457543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5" event={"ID":"4ca88908-8abd-4421-b1ff-7ca0490250ff","Type":"ContainerStarted","Data":"aa4a03bdb5e2ede45fee6afa5b046b1c4bcb956952df0f7ab84106be171873ba"}
Sep 10 22:19:45.467889 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.467863    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-cmpx8"
Sep 10 22:19:45.475090 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.474932    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c4c87c6f4-5vwn4" podStartSLOduration=2.474892279 podStartE2EDuration="2.474892279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:45.473587848 +0000 UTC m=+92.057664889" watchObservedRunningTime="2026-09-10 22:19:45.474892279 +0000 UTC m=+92.058969319"
Sep 10 22:19:45.498860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.498666    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:45.519580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.519550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:45.589751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:45.589716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:46.461072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:46.461036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:19:46.467789 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:46.467758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6cz" event={"ID":"546c5848-3e75-4174-9aa7-0a3c17279075","Type":"ContainerStarted","Data":"a70bb024cfafc33f3da50f961120f6d389b4a99bbe895fbb7fb6cc1d015f46bd"}
Sep 10 22:19:47.361940 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.361910    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-959988f94-nwq58"
Sep 10 22:19:47.474698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.474647    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5" event={"ID":"4ca88908-8abd-4421-b1ff-7ca0490250ff","Type":"ContainerStarted","Data":"7d0f19ae16518c294356c8e6425e68ca70b8ac819553106f8cfe26c90fab32f1"}
Sep 10 22:19:47.475125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.474737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5" event={"ID":"4ca88908-8abd-4421-b1ff-7ca0490250ff","Type":"ContainerStarted","Data":"62605dba52045add584478d0d0e37c311d28d2f4598b928851fa81b7ac0e9b74"}
Sep 10 22:19:47.475125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.474771    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5" event={"ID":"4ca88908-8abd-4421-b1ff-7ca0490250ff","Type":"ContainerStarted","Data":"89676314178b468a28712fb19d7dbbb48972f32759668682232794b642438da6"}
Sep 10 22:19:47.477278 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.477247    2559 generic.go:356] "Generic (PLEG): container finished" podID="546c5848-3e75-4174-9aa7-0a3c17279075" containerID="a70bb024cfafc33f3da50f961120f6d389b4a99bbe895fbb7fb6cc1d015f46bd" exitCode=0
Sep 10 22:19:47.477402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.477338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6cz" event={"ID":"546c5848-3e75-4174-9aa7-0a3c17279075","Type":"ContainerDied","Data":"a70bb024cfafc33f3da50f961120f6d389b4a99bbe895fbb7fb6cc1d015f46bd"}
Sep 10 22:19:47.477402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.477378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6cz" event={"ID":"546c5848-3e75-4174-9aa7-0a3c17279075","Type":"ContainerStarted","Data":"b1ac6b655849d830843fab1f362ed5199c32f7a0690e94ae6ce2157bff23b29a"}
Sep 10 22:19:47.477550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.477403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hc6cz" event={"ID":"546c5848-3e75-4174-9aa7-0a3c17279075","Type":"ContainerStarted","Data":"3673f66ca6d6953a64359dcf6ec3cb8dd421c6ade2f7f8e0bdc7cfc94547bbb0"}
Sep 10 22:19:47.479211 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.479189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cf6dcdb-48xtr" event={"ID":"0180378d-94bd-4b66-93f6-9797c2c5262a","Type":"ContainerStarted","Data":"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"}
Sep 10 22:19:47.479327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.479226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cf6dcdb-48xtr" event={"ID":"0180378d-94bd-4b66-93f6-9797c2c5262a","Type":"ContainerStarted","Data":"e09dc7ecccb2721ad48d27701fad29fabba09ac887855bb516c00454bd44347c"}
Sep 10 22:19:47.508644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.508590    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-cr8t5" podStartSLOduration=10.491178125 podStartE2EDuration="12.508571131s" totalImagesPullingTime="2.017393006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:47.506845552 +0000 UTC m=+94.090922593" watchObservedRunningTime="2026-09-10 22:19:47.508571131 +0000 UTC m=+94.092648171"
Sep 10 22:19:47.522153 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.522121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:47.536007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.535613    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hc6cz" podStartSLOduration=10.419770551 podStartE2EDuration="12.535596933s" totalImagesPullingTime="2.015276682s" totalInitContainerRuntime="100.5497ms" isStatefulPod=true podCreationTimestamp="2026-09-10 22:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:47.535062515 +0000 UTC m=+94.119139570" watchObservedRunningTime="2026-09-10 22:19:47.535596933 +0000 UTC m=+94.119673974"
Sep 10 22:19:47.564775 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.564730    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57cf6dcdb-48xtr" podStartSLOduration=2.564715125 podStartE2EDuration="2.564715125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:47.562631482 +0000 UTC m=+94.146708557" watchObservedRunningTime="2026-09-10 22:19:47.564715125 +0000 UTC m=+94.148792168"
Sep 10 22:19:47.623417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.623361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:47.749623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:47.749592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:49.243669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.243632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:49.338306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.338271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:49.341902 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.341873    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" podUID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" containerName="registry" containerID="cri-o://81f54522e9c4431310431b7f92c0fd94af56f3f6682b7f9553369739c8bb77a9" gracePeriod=30
Sep 10 22:19:49.495823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.495729    2559 generic.go:356] "Generic (PLEG): container finished" podID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" containerID="81f54522e9c4431310431b7f92c0fd94af56f3f6682b7f9553369739c8bb77a9" exitCode=0
Sep 10 22:19:49.495823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.495795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" event={"ID":"96beb033-6c95-4f8e-9445-bd9cbaf6e146","Type":"ContainerDied","Data":"81f54522e9c4431310431b7f92c0fd94af56f3f6682b7f9553369739c8bb77a9"}
Sep 10 22:19:49.636856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.636832    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:49.650034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650005    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650045    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650065    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlwjk\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650229    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650259    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration\") pod \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\" (UID: \"96beb033-6c95-4f8e-9445-bd9cbaf6e146\") "
Sep 10 22:19:49.650557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650388    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:49.650557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.650549    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-certificates\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.651567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.651527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:19:49.653042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.652999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:49.653332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.653299    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:19:49.653732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.653708    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:49.654989 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.654952    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk" (OuterVolumeSpecName: "kube-api-access-tlwjk") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "kube-api-access-tlwjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:19:49.654989 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.654964    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:19:49.661327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.661300    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "96beb033-6c95-4f8e-9445-bd9cbaf6e146" (UID: "96beb033-6c95-4f8e-9445-bd9cbaf6e146"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:19:49.751085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751007    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96beb033-6c95-4f8e-9445-bd9cbaf6e146-ca-trust-extracted\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751056    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96beb033-6c95-4f8e-9445-bd9cbaf6e146-trusted-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751086    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-image-registry-private-configuration\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751124    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-registry-tls\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751137    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-bound-sa-token\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751149    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlwjk\" (UniqueName: \"kubernetes.io/projected/96beb033-6c95-4f8e-9445-bd9cbaf6e146-kube-api-access-tlwjk\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:49.751342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:49.751161    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96beb033-6c95-4f8e-9445-bd9cbaf6e146-installation-pull-secrets\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:19:50.445903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.445868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:19:50.501877 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.501841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558d44c5df-8ng86" event={"ID":"96beb033-6c95-4f8e-9445-bd9cbaf6e146","Type":"ContainerDied","Data":"6f58e771aa0d3f8e2a449f5e64f59c6ddfe34a0f396d07ea76fce43f52387adb"}
Sep 10 22:19:50.502042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.501908    2559 scope.go:117] "RemoveContainer" containerID="81f54522e9c4431310431b7f92c0fd94af56f3f6682b7f9553369739c8bb77a9"
Sep 10 22:19:50.502042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.501858    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558d44c5df-8ng86"
Sep 10 22:19:50.523662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.523635    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:19:50.528311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:50.528289    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-558d44c5df-8ng86"]
Sep 10 22:19:51.007596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:51.007558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:51.116463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:51.116426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:51.471506 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:51.471463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:51.566218 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:51.566182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:51.891755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:51.891678    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" path="/var/lib/kubelet/pods/96beb033-6c95-4f8e-9445-bd9cbaf6e146/volumes"
Sep 10 22:19:53.462552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.462519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:53.462904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.462604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:53.467056 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.467036    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:53.519659 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.519634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:19:53.620878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.620851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:53.713156 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:53.713058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:54.612524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:54.612479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:54.668812 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:54.668765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.404052 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.404025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.464443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.464414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.501133 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.501113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:55.501223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.501181    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:55.505735 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.505716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:55.530173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.530153    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:19:55.587406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.587385    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:19:55.689727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.689650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.790543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.790509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.895791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.895748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:55.996554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:55.996525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:19:57.359597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:19:57.359568    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kng8t"
Sep 10 22:20:08.615504 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:08.615455    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:08.674683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:08.674656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:09.489216 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.489158    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79cf574847-6qgc5" podUID="26f52918-3f6b-4fce-b519-f17ce56f8d00" containerName="console" containerID="cri-o://3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc" gracePeriod=15
Sep 10 22:20:09.760049 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.759996    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:20:09.794535 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.794649 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.794649 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794576    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6whs\" (UniqueName: \"kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.794649 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794642    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.794780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.794780 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config\") pod \"26f52918-3f6b-4fce-b519-f17ce56f8d00\" (UID: \"26f52918-3f6b-4fce-b519-f17ce56f8d00\") "
Sep 10 22:20:09.795042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.794931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca" (OuterVolumeSpecName: "service-ca") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:09.795153 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.795124    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:09.795222 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.795172    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config" (OuterVolumeSpecName: "console-config") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:09.797047 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.797022    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs" (OuterVolumeSpecName: "kube-api-access-c6whs") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "kube-api-access-c6whs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:09.797139 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.797076    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:20:09.797544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.797518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26f52918-3f6b-4fce-b519-f17ce56f8d00" (UID: "26f52918-3f6b-4fce-b519-f17ce56f8d00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:20:09.895195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895173    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.895195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895192    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.895353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895200    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.895353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895209    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6whs\" (UniqueName: \"kubernetes.io/projected/26f52918-3f6b-4fce-b519-f17ce56f8d00-kube-api-access-c6whs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.895353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895218    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26f52918-3f6b-4fce-b519-f17ce56f8d00-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:09.895353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:09.895226    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26f52918-3f6b-4fce-b519-f17ce56f8d00-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:10.576250 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.576207    2559 generic.go:356] "Generic (PLEG): container finished" podID="26f52918-3f6b-4fce-b519-f17ce56f8d00" containerID="3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc" exitCode=0
Sep 10 22:20:10.576402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.576250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf574847-6qgc5" event={"ID":"26f52918-3f6b-4fce-b519-f17ce56f8d00","Type":"ContainerDied","Data":"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"}
Sep 10 22:20:10.576402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.576265    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf574847-6qgc5"
Sep 10 22:20:10.576402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.576329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf574847-6qgc5" event={"ID":"26f52918-3f6b-4fce-b519-f17ce56f8d00","Type":"ContainerDied","Data":"2187548a693a575ce39fa8636b4e7cdaec674a9304a7cf8075c032a22c8caf98"}
Sep 10 22:20:10.576402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.576350    2559 scope.go:117] "RemoveContainer" containerID="3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"
Sep 10 22:20:10.584333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.584318    2559 scope.go:117] "RemoveContainer" containerID="3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"
Sep 10 22:20:10.584616 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:20:10.584598    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc\": container with ID starting with 3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc not found: ID does not exist" containerID="3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"
Sep 10 22:20:10.584684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.584621    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc"} err="failed to get container status \"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc\": rpc error: code = NotFound desc = could not find container \"3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc\": container with ID starting with 3fc71299afe0c3fb405cf0838c75373c53f29388d32eae4d71710ffb8b15d2fc not found: ID does not exist"
Sep 10 22:20:10.592515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.592480    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:20:10.596912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:10.596893    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cf574847-6qgc5"]
Sep 10 22:20:11.889911 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:11.889879    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f52918-3f6b-4fce-b519-f17ce56f8d00" path="/var/lib/kubelet/pods/26f52918-3f6b-4fce-b519-f17ce56f8d00/volumes"
Sep 10 22:20:20.610701 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.610658    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c4c87c6f4-5vwn4" podUID="9b832215-e84e-49f1-bdbd-388e037924a8" containerName="console" containerID="cri-o://1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8" gracePeriod=15
Sep 10 22:20:20.886951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.886903    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:20:20.968483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968511    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4khk\" (UniqueName: \"kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968562    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968591    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968629    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968679    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.968790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968707    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config\") pod \"9b832215-e84e-49f1-bdbd-388e037924a8\" (UID: \"9b832215-e84e-49f1-bdbd-388e037924a8\") "
Sep 10 22:20:20.969025 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.968998    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:20.969103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.969002    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:20.969103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.969063    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:20.969521 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.969478    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config" (OuterVolumeSpecName: "console-config") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:20:20.970685 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.970664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:20:20.971011 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.970992    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk" (OuterVolumeSpecName: "kube-api-access-t4khk") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "kube-api-access-t4khk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:20:20.971061 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:20.971002    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b832215-e84e-49f1-bdbd-388e037924a8" (UID: "9b832215-e84e-49f1-bdbd-388e037924a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:20:21.069607 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069584    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-trusted-ca-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069607 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069605    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069614    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069624    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4khk\" (UniqueName: \"kubernetes.io/projected/9b832215-e84e-49f1-bdbd-388e037924a8-kube-api-access-t4khk\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069632    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069640    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b832215-e84e-49f1-bdbd-388e037924a8-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.069716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.069648    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b832215-e84e-49f1-bdbd-388e037924a8-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:20:21.614804 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.614766    2559 generic.go:356] "Generic (PLEG): container finished" podID="9b832215-e84e-49f1-bdbd-388e037924a8" containerID="1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8" exitCode=0
Sep 10 22:20:21.615178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.614811    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c4c87c6f4-5vwn4"
Sep 10 22:20:21.615178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.614812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4c87c6f4-5vwn4" event={"ID":"9b832215-e84e-49f1-bdbd-388e037924a8","Type":"ContainerDied","Data":"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"}
Sep 10 22:20:21.615178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.614859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c4c87c6f4-5vwn4" event={"ID":"9b832215-e84e-49f1-bdbd-388e037924a8","Type":"ContainerDied","Data":"0e2344de3209e394f1ebb403417480bf1dfbd8d6fecfb881f662473afa962fa5"}
Sep 10 22:20:21.615178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.614901    2559 scope.go:117] "RemoveContainer" containerID="1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"
Sep 10 22:20:21.622827 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.622622    2559 scope.go:117] "RemoveContainer" containerID="1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"
Sep 10 22:20:21.622964 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:20:21.622943    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8\": container with ID starting with 1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8 not found: ID does not exist" containerID="1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"
Sep 10 22:20:21.623024 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.622979    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8"} err="failed to get container status \"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8\": rpc error: code = NotFound desc = could not find container \"1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8\": container with ID starting with 1291a78f58670d9854ef3f4892239b92205af2f9742b46723544000a26b0d4a8 not found: ID does not exist"
Sep 10 22:20:21.640905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.640882    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:20:21.643140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.643121    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c4c87c6f4-5vwn4"]
Sep 10 22:20:21.890111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:21.890051    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b832215-e84e-49f1-bdbd-388e037924a8" path="/var/lib/kubelet/pods/9b832215-e84e-49f1-bdbd-388e037924a8/volumes"
Sep 10 22:20:51.146501 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:51.146456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:51.203726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:51.203680    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:57.133526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133482    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133789    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f52918-3f6b-4fce-b519-f17ce56f8d00" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f52918-3f6b-4fce-b519-f17ce56f8d00" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133815    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b832215-e84e-49f1-bdbd-388e037924a8" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133820    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b832215-e84e-49f1-bdbd-388e037924a8" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133831    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" containerName="registry"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133837    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" containerName="registry"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133876    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b832215-e84e-49f1-bdbd-388e037924a8" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133889    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f52918-3f6b-4fce-b519-f17ce56f8d00" containerName="console"
Sep 10 22:20:57.133934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.133895    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="96beb033-6c95-4f8e-9445-bd9cbaf6e146" containerName="registry"
Sep 10 22:20:57.136524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.136505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.147234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.147211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:20:57.184274 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.184252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:57.212186 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.212448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.212403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.238401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.238380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:20:57.313518 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313518 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.313662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.313632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.314275 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.314254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.314417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.314301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.314417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.314301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.314557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.314470    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.316248 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.316228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.316348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.316333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.321037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.321009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj\") pod \"console-776fb744c7-nn47s\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") " pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.446915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.446867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:20:57.716409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.716382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:20:57.719631 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:20:57.719605    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac42f86d_5200_428d_be4c_793a4cf4ec88.slice/crio-5e31710446349421d22fa3f7109b922481e37382a565e780ac44e354659a53fb WatchSource:0}: Error finding container 5e31710446349421d22fa3f7109b922481e37382a565e780ac44e354659a53fb: Status 404 returned error can't find the container with id 5e31710446349421d22fa3f7109b922481e37382a565e780ac44e354659a53fb
Sep 10 22:20:57.742341 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:57.742320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776fb744c7-nn47s" event={"ID":"ac42f86d-5200-428d-be4c-793a4cf4ec88","Type":"ContainerStarted","Data":"5e31710446349421d22fa3f7109b922481e37382a565e780ac44e354659a53fb"}
Sep 10 22:20:58.746599 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:58.746564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776fb744c7-nn47s" event={"ID":"ac42f86d-5200-428d-be4c-793a4cf4ec88","Type":"ContainerStarted","Data":"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"}
Sep 10 22:20:58.763410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:20:58.763366    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776fb744c7-nn47s" podStartSLOduration=1.763351298 podStartE2EDuration="1.763351298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:20:58.762427051 +0000 UTC m=+165.346504094" watchObservedRunningTime="2026-09-10 22:20:58.763351298 +0000 UTC m=+165.347428337"
Sep 10 22:21:03.265667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:03.265632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:03.367428 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:03.367392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:07.447976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.447902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:21:07.447976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.447963    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:21:07.452271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.452245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:21:07.782622 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.782597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:21:07.826994 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.826962    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:21:07.931777 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.931744    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:07.986193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:07.986169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.046562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:08.046503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.608661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:08.608626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:08.707461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:08.707434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:14.350961 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:14.350916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:32.845441 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:32.845393    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57cf6dcdb-48xtr" podUID="0180378d-94bd-4b66-93f6-9797c2c5262a" containerName="console" containerID="cri-o://06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab" gracePeriod=15
Sep 10 22:21:33.091010 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.090987    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:21:33.174682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174611    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hn75\" (UniqueName: \"kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.174682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174643    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.174682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174666    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.174921 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174699    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.174921 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174846    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.175020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.175020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.174987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert\") pod \"0180378d-94bd-4b66-93f6-9797c2c5262a\" (UID: \"0180378d-94bd-4b66-93f6-9797c2c5262a\") "
Sep 10 22:21:33.175128 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.175100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca" (OuterVolumeSpecName: "service-ca") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:33.175206 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.175109    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:33.175411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.175222    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.175411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.175211    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config" (OuterVolumeSpecName: "console-config") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:33.175506 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.175426    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:33.176910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.176886    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:33.177293 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.177268    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:33.177293 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.177279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75" (OuterVolumeSpecName: "kube-api-access-8hn75") pod "0180378d-94bd-4b66-93f6-9797c2c5262a" (UID: "0180378d-94bd-4b66-93f6-9797c2c5262a"). InnerVolumeSpecName "kube-api-access-8hn75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:33.275709 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275677    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.275709 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275705    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hn75\" (UniqueName: \"kubernetes.io/projected/0180378d-94bd-4b66-93f6-9797c2c5262a-kube-api-access-8hn75\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.275892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275719    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.275892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275732    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-trusted-ca-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.275892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275748    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0180378d-94bd-4b66-93f6-9797c2c5262a-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.275892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.275760    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0180378d-94bd-4b66-93f6-9797c2c5262a-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:33.867040 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.867006    2559 generic.go:356] "Generic (PLEG): container finished" podID="0180378d-94bd-4b66-93f6-9797c2c5262a" containerID="06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab" exitCode=0
Sep 10 22:21:33.867545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.867051    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cf6dcdb-48xtr"
Sep 10 22:21:33.867545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.867050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cf6dcdb-48xtr" event={"ID":"0180378d-94bd-4b66-93f6-9797c2c5262a","Type":"ContainerDied","Data":"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"}
Sep 10 22:21:33.867545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.867170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cf6dcdb-48xtr" event={"ID":"0180378d-94bd-4b66-93f6-9797c2c5262a","Type":"ContainerDied","Data":"e09dc7ecccb2721ad48d27701fad29fabba09ac887855bb516c00454bd44347c"}
Sep 10 22:21:33.867545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.867194    2559 scope.go:117] "RemoveContainer" containerID="06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"
Sep 10 22:21:33.875744 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.875727    2559 scope.go:117] "RemoveContainer" containerID="06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"
Sep 10 22:21:33.876035 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:21:33.876019    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab\": container with ID starting with 06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab not found: ID does not exist" containerID="06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"
Sep 10 22:21:33.876091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.876045    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab"} err="failed to get container status \"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab\": rpc error: code = NotFound desc = could not find container \"06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab\": container with ID starting with 06f2ee74f77383efe2335971eb8a57baa80355016b7ace0e3f834821e80cc1ab not found: ID does not exist"
Sep 10 22:21:33.890104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.890075    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:21:33.893114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:33.893085    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57cf6dcdb-48xtr"]
Sep 10 22:21:35.889609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:35.889572    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0180378d-94bd-4b66-93f6-9797c2c5262a" path="/var/lib/kubelet/pods/0180378d-94bd-4b66-93f6-9797c2c5262a/volumes"
Sep 10 22:21:38.327076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:38.327045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:38.429657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:38.429616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:39.130737 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.130703    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"]
Sep 10 22:21:39.130980 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.130967    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0180378d-94bd-4b66-93f6-9797c2c5262a" containerName="console"
Sep 10 22:21:39.131030 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.130982    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0180378d-94bd-4b66-93f6-9797c2c5262a" containerName="console"
Sep 10 22:21:39.131030 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.131029    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0180378d-94bd-4b66-93f6-9797c2c5262a" containerName="console"
Sep 10 22:21:39.132954 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.132938    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.135401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.135383    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:21:39.136570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.136554    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmzck\""
Sep 10 22:21:39.136662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.136569    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:21:39.143219 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.143199    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"]
Sep 10 22:21:39.221682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.221646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfvz\" (UniqueName: \"kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.221682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.221685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.221891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.221717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.322878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.322834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfvz\" (UniqueName: \"kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.323045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.322890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.323045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.322936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.323281 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.323259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.323353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.323302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.331434 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.331412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfvz\" (UniqueName: \"kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.441235 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.441177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:39.711307 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.711282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"]
Sep 10 22:21:39.713959 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:21:39.713933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2533bbcf_aba4_4762_89bf_419ed0643ffd.slice/crio-c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812 WatchSource:0}: Error finding container c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812: Status 404 returned error can't find the container with id c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812
Sep 10 22:21:39.889745 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:39.889703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq" event={"ID":"2533bbcf-aba4-4762-89bf-419ed0643ffd","Type":"ContainerStarted","Data":"c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812"}
Sep 10 22:21:45.910911 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:45.910821    2559 generic.go:356] "Generic (PLEG): container finished" podID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerID="6cc406df1c1c49282e065ee5c5e8bcd4c1a4d6460f3f541940f6c48b6d256330" exitCode=0
Sep 10 22:21:45.910911 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:45.910899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq" event={"ID":"2533bbcf-aba4-4762-89bf-419ed0643ffd","Type":"ContainerDied","Data":"6cc406df1c1c49282e065ee5c5e8bcd4c1a4d6460f3f541940f6c48b6d256330"}
Sep 10 22:21:48.923323 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:48.923285    2559 generic.go:356] "Generic (PLEG): container finished" podID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerID="27fe0b12c5a5dab18dd583ec1e16e848144965b5616e3c388063300163d24172" exitCode=0
Sep 10 22:21:48.923711 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:48.923364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq" event={"ID":"2533bbcf-aba4-4762-89bf-419ed0643ffd","Type":"ContainerDied","Data":"27fe0b12c5a5dab18dd583ec1e16e848144965b5616e3c388063300163d24172"}
Sep 10 22:21:56.956724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:56.956669    2559 generic.go:356] "Generic (PLEG): container finished" podID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerID="843fbc9ca35d975b23a88dc1cab2f5b328fdbb97add8c56a6075e4d90eaa3d0f" exitCode=0
Sep 10 22:21:56.957083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:56.956750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq" event={"ID":"2533bbcf-aba4-4762-89bf-419ed0643ffd","Type":"ContainerDied","Data":"843fbc9ca35d975b23a88dc1cab2f5b328fdbb97add8c56a6075e4d90eaa3d0f"}
Sep 10 22:21:58.077395 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.077372    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:58.185238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.185202    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util\") pod \"2533bbcf-aba4-4762-89bf-419ed0643ffd\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") "
Sep 10 22:21:58.185378 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.185251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrfvz\" (UniqueName: \"kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz\") pod \"2533bbcf-aba4-4762-89bf-419ed0643ffd\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") "
Sep 10 22:21:58.185378 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.185311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle\") pod \"2533bbcf-aba4-4762-89bf-419ed0643ffd\" (UID: \"2533bbcf-aba4-4762-89bf-419ed0643ffd\") "
Sep 10 22:21:58.186079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.186052    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle" (OuterVolumeSpecName: "bundle") pod "2533bbcf-aba4-4762-89bf-419ed0643ffd" (UID: "2533bbcf-aba4-4762-89bf-419ed0643ffd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:58.187535 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.187463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz" (OuterVolumeSpecName: "kube-api-access-hrfvz") pod "2533bbcf-aba4-4762-89bf-419ed0643ffd" (UID: "2533bbcf-aba4-4762-89bf-419ed0643ffd"). InnerVolumeSpecName "kube-api-access-hrfvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:58.189327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.189303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util" (OuterVolumeSpecName: "util") pod "2533bbcf-aba4-4762-89bf-419ed0643ffd" (UID: "2533bbcf-aba4-4762-89bf-419ed0643ffd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:58.285887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.285808    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:58.285887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.285833    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2533bbcf-aba4-4762-89bf-419ed0643ffd-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:58.285887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.285842    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrfvz\" (UniqueName: \"kubernetes.io/projected/2533bbcf-aba4-4762-89bf-419ed0643ffd-kube-api-access-hrfvz\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:21:58.519640 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.519611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:58.578161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.578086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:21:58.965162 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.965137    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq"
Sep 10 22:21:58.965162 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.965140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kctrq" event={"ID":"2533bbcf-aba4-4762-89bf-419ed0643ffd","Type":"ContainerDied","Data":"c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812"}
Sep 10 22:21:58.965348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:21:58.965185    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c01fca1ff6f2b351347d3494ce816245a8a3db5dc8e05bf2c8b33832c2450812"
Sep 10 22:22:00.130106 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:00.130068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:01.929058 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:01.929025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:03.753537 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:03.753475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:03.853820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:03.853785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:06.267198 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.267160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:06.368324 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.368285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:06.454288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454256    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hf7bv"]
Sep 10 22:22:06.454522 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454511    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="extract"
Sep 10 22:22:06.454522 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454523    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="extract"
Sep 10 22:22:06.454615 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454533    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="pull"
Sep 10 22:22:06.454615 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454538    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="pull"
Sep 10 22:22:06.454615 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454547    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="util"
Sep 10 22:22:06.454615 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454553    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="util"
Sep 10 22:22:06.454615 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.454598    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2533bbcf-aba4-4762-89bf-419ed0643ffd" containerName="extract"
Sep 10 22:22:06.456351 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.456335    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.458815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.458794    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 22:22:06.459666 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.459648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-77lsr\""
Sep 10 22:22:06.459759 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.459653    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 22:22:06.469221 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.469196    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hf7bv"]
Sep 10 22:22:06.549823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.549757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgcnb\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-kube-api-access-pgcnb\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.549823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.549797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.651023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.651000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgcnb\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-kube-api-access-pgcnb\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.651168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.651031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.669099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.669064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.670603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.670583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgcnb\" (UniqueName: \"kubernetes.io/projected/60f51082-c181-4b20-a528-8ada919168bb-kube-api-access-pgcnb\") pod \"cert-manager-webhook-6486ffd997-hf7bv\" (UID: \"60f51082-c181-4b20-a528-8ada919168bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:06.781166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:06.781136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:07.057844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:07.057812    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hf7bv"]
Sep 10 22:22:07.061146 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:22:07.061115    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f51082_c181_4b20_a528_8ada919168bb.slice/crio-bc2f8bc97edd2b6fa4e282d74ba2a0d8aec74581e70513ec961b33d90adccd03 WatchSource:0}: Error finding container bc2f8bc97edd2b6fa4e282d74ba2a0d8aec74581e70513ec961b33d90adccd03: Status 404 returned error can't find the container with id bc2f8bc97edd2b6fa4e282d74ba2a0d8aec74581e70513ec961b33d90adccd03
Sep 10 22:22:08.002525 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:08.002476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv" event={"ID":"60f51082-c181-4b20-a528-8ada919168bb","Type":"ContainerStarted","Data":"bc2f8bc97edd2b6fa4e282d74ba2a0d8aec74581e70513ec961b33d90adccd03"}
Sep 10 22:22:08.599111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:08.599081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:08.803505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:08.803452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:10.012375 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:10.012340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv" event={"ID":"60f51082-c181-4b20-a528-8ada919168bb","Type":"ContainerStarted","Data":"67eefd91334fc4bbed93549ea1fbd30a893d56c6942d329bce5fa6be61a0fcb2"}
Sep 10 22:22:10.012785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:10.012480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:10.028567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:10.028441    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv" podStartSLOduration=1.584826418 podStartE2EDuration="4.028423259s" totalImagesPullingTime="2.443596841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:22:10.028094828 +0000 UTC m=+236.612171868" watchObservedRunningTime="2026-09-10 22:22:10.028423259 +0000 UTC m=+236.612500300"
Sep 10 22:22:10.968145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:10.968109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:11.022328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:11.022278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:14.989104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:14.989069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:15.109112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:15.109086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:15.812109 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:15.812057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:16.018856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:16.018828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hf7bv"
Sep 10 22:22:17.161604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:17.161570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:17.222081 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:17.222048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:23.418442 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:23.418405    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:35.006309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:35.006271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:35.124264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:35.124224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:37.324259 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.324175    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"]
Sep 10 22:22:37.326611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.326590    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.329007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.328987    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 22:22:37.329167 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.329146    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:22:37.330274 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.330260    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-424l5\""
Sep 10 22:22:37.345734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.345707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"]
Sep 10 22:22:37.378810 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.378787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c176352-5522-4678-a0e1-4b5d9028dd17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.378919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.378815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78ssw\" (UniqueName: \"kubernetes.io/projected/5c176352-5522-4678-a0e1-4b5d9028dd17-kube-api-access-78ssw\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.480015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.479986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c176352-5522-4678-a0e1-4b5d9028dd17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.480015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.480016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78ssw\" (UniqueName: \"kubernetes.io/projected/5c176352-5522-4678-a0e1-4b5d9028dd17-kube-api-access-78ssw\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.480358 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.480340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c176352-5522-4678-a0e1-4b5d9028dd17-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.487929 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.487908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78ssw\" (UniqueName: \"kubernetes.io/projected/5c176352-5522-4678-a0e1-4b5d9028dd17-kube-api-access-78ssw\") pod \"openshift-lws-operator-fd8ccff4c-q6pwb\" (UID: \"5c176352-5522-4678-a0e1-4b5d9028dd17\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.635643 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.635573    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"
Sep 10 22:22:37.905665 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:37.905476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb"]
Sep 10 22:22:37.908822 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:22:37.908796    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c176352_5522_4678_a0e1_4b5d9028dd17.slice/crio-0cdeddf274f6663044e791616705a46c91529191895ef7db19a11bb33b96a039 WatchSource:0}: Error finding container 0cdeddf274f6663044e791616705a46c91529191895ef7db19a11bb33b96a039: Status 404 returned error can't find the container with id 0cdeddf274f6663044e791616705a46c91529191895ef7db19a11bb33b96a039
Sep 10 22:22:38.110401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:38.110366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb" event={"ID":"5c176352-5522-4678-a0e1-4b5d9028dd17","Type":"ContainerStarted","Data":"0cdeddf274f6663044e791616705a46c91529191895ef7db19a11bb33b96a039"}
Sep 10 22:22:41.123767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:41.123725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb" event={"ID":"5c176352-5522-4678-a0e1-4b5d9028dd17","Type":"ContainerStarted","Data":"3421021e42f655278f81a4deeca93155191d5650ee3cf8cc047bd9e62e50af1d"}
Sep 10 22:22:41.142240 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:41.142184    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q6pwb" podStartSLOduration=1.416053297 podStartE2EDuration="4.142166354s" totalImagesPullingTime="2.726113057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:22:41.14046194 +0000 UTC m=+267.724538982" watchObservedRunningTime="2026-09-10 22:22:41.142166354 +0000 UTC m=+267.726243396"
Sep 10 22:22:41.828572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:41.828541    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:41.928601 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:41.928573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:43.552734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.552700    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"]
Sep 10 22:22:43.555117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.555099    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.557404 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.557381    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 22:22:43.557554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.557386    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 22:22:43.558289 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.558268    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pmzck\""
Sep 10 22:22:43.563912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.563887    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"]
Sep 10 22:22:43.626641 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.626620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.626795 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.626650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkgfw\" (UniqueName: \"kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.626795 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.626693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.727536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.727676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.727730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkgfw\" (UniqueName: \"kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.727967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.728019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:43.730515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.728337    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.735432 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.735411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkgfw\" (UniqueName: \"kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:43.864365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:43.864296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:44.141511 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:44.141468    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"]
Sep 10 22:22:44.143067 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:22:44.143044    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e81c6c_f8bb_4bf8_b7de_80f936cd43da.slice/crio-a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93 WatchSource:0}: Error finding container a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93: Status 404 returned error can't find the container with id a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93
Sep 10 22:22:45.140437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:45.140357    2559 generic.go:356] "Generic (PLEG): container finished" podID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerID="d3121fa55a7c3b9d229cebf38cede7aa32f65a4e8f012c500ef718226d99f73f" exitCode=0
Sep 10 22:22:45.140803 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:45.140444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb" event={"ID":"65e81c6c-f8bb-4bf8-b7de-80f936cd43da","Type":"ContainerDied","Data":"d3121fa55a7c3b9d229cebf38cede7aa32f65a4e8f012c500ef718226d99f73f"}
Sep 10 22:22:45.140803 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:45.140503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb" event={"ID":"65e81c6c-f8bb-4bf8-b7de-80f936cd43da","Type":"ContainerStarted","Data":"a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93"}
Sep 10 22:22:46.145827 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:46.145721    2559 generic.go:356] "Generic (PLEG): container finished" podID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerID="e7e4acc603de7dfbfe16bbbcbfa2736b1b06e855cb814942dec747482e19ad54" exitCode=0
Sep 10 22:22:46.146223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:46.145823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb" event={"ID":"65e81c6c-f8bb-4bf8-b7de-80f936cd43da","Type":"ContainerDied","Data":"e7e4acc603de7dfbfe16bbbcbfa2736b1b06e855cb814942dec747482e19ad54"}
Sep 10 22:22:47.151391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:47.151363    2559 generic.go:356] "Generic (PLEG): container finished" podID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerID="4488d5b94ca43bfae16e5fab20f3addfc1dac7dab13c54c9ab47e4fb51eeb05e" exitCode=0
Sep 10 22:22:47.151786 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:47.151433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb" event={"ID":"65e81c6c-f8bb-4bf8-b7de-80f936cd43da","Type":"ContainerDied","Data":"4488d5b94ca43bfae16e5fab20f3addfc1dac7dab13c54c9ab47e4fb51eeb05e"}
Sep 10 22:22:47.957444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:47.957410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:47.997775 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:47.997747    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"]
Sep 10 22:22:48.000837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.000821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.003195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.003178    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 22:22:48.003296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.003212    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h9csj\""
Sep 10 22:22:48.004192 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.004174    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 22:22:48.004302 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.004226    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 22:22:48.009133 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.009103    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"]
Sep 10 22:22:48.050596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.050567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:48.061427 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.061404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/40123329-17f5-4c1b-a91c-67068490a72f-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.061563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.061431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.061563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.061450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gpw\" (UniqueName: \"kubernetes.io/projected/40123329-17f5-4c1b-a91c-67068490a72f-kube-api-access-92gpw\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.061678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.061586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.162634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.162607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.162918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.162644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gpw\" (UniqueName: \"kubernetes.io/projected/40123329-17f5-4c1b-a91c-67068490a72f-kube-api-access-92gpw\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.162918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.162705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.162918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.162761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/40123329-17f5-4c1b-a91c-67068490a72f-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.163382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.163358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/40123329-17f5-4c1b-a91c-67068490a72f-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.165116 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.165094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.165211 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.165117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40123329-17f5-4c1b-a91c-67068490a72f-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.175836 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.175812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gpw\" (UniqueName: \"kubernetes.io/projected/40123329-17f5-4c1b-a91c-67068490a72f-kube-api-access-92gpw\") pod \"lws-controller-manager-5dbdc5d69b-fs4bp\" (UID: \"40123329-17f5-4c1b-a91c-67068490a72f\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.274419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.274391    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:48.310668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.310640    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:48.365188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.365154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle\") pod \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") "
Sep 10 22:22:48.365314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.365236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util\") pod \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") "
Sep 10 22:22:48.365314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.365272    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkgfw\" (UniqueName: \"kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw\") pod \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\" (UID: \"65e81c6c-f8bb-4bf8-b7de-80f936cd43da\") "
Sep 10 22:22:48.367266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.367221    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle" (OuterVolumeSpecName: "bundle") pod "65e81c6c-f8bb-4bf8-b7de-80f936cd43da" (UID: "65e81c6c-f8bb-4bf8-b7de-80f936cd43da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:22:48.370981 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.370945    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw" (OuterVolumeSpecName: "kube-api-access-gkgfw") pod "65e81c6c-f8bb-4bf8-b7de-80f936cd43da" (UID: "65e81c6c-f8bb-4bf8-b7de-80f936cd43da"). InnerVolumeSpecName "kube-api-access-gkgfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:22:48.374717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.374689    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util" (OuterVolumeSpecName: "util") pod "65e81c6c-f8bb-4bf8-b7de-80f936cd43da" (UID: "65e81c6c-f8bb-4bf8-b7de-80f936cd43da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:22:48.466664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.466638    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-util\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:22:48.466664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.466661    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkgfw\" (UniqueName: \"kubernetes.io/projected/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-kube-api-access-gkgfw\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:22:48.466816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.466671    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65e81c6c-f8bb-4bf8-b7de-80f936cd43da-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:22:48.583115 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:48.583050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"]
Sep 10 22:22:48.585765 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:22:48.585742    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40123329_17f5_4c1b_a91c_67068490a72f.slice/crio-364c10c6ac5c6d7f5ccf05d1f56c21e0edfe06b87177d6c2ca5a5631212c3426 WatchSource:0}: Error finding container 364c10c6ac5c6d7f5ccf05d1f56c21e0edfe06b87177d6c2ca5a5631212c3426: Status 404 returned error can't find the container with id 364c10c6ac5c6d7f5ccf05d1f56c21e0edfe06b87177d6c2ca5a5631212c3426
Sep 10 22:22:49.161562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:49.161523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb" event={"ID":"65e81c6c-f8bb-4bf8-b7de-80f936cd43da","Type":"ContainerDied","Data":"a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93"}
Sep 10 22:22:49.161562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:49.161560    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq7pwb"
Sep 10 22:22:49.161809 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:49.161581    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1133b4c2e5f77be0a4445693064d1c3956a197d5cf3bfda5f9edc2b8eb86d93"
Sep 10 22:22:49.162847 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:49.162815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp" event={"ID":"40123329-17f5-4c1b-a91c-67068490a72f","Type":"ContainerStarted","Data":"364c10c6ac5c6d7f5ccf05d1f56c21e0edfe06b87177d6c2ca5a5631212c3426"}
Sep 10 22:22:50.167623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:50.167544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp" event={"ID":"40123329-17f5-4c1b-a91c-67068490a72f","Type":"ContainerStarted","Data":"00c006357d1c37e1d2c8dad15ef8de2a2710c7b435bf0f0eb3753115a776236c"}
Sep 10 22:22:50.167623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:50.167617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:22:50.184450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:50.184402    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp" podStartSLOduration=1.863239088 podStartE2EDuration="3.184387828s" totalImagesPullingTime="1.32114874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:22:50.182585093 +0000 UTC m=+276.766662149" watchObservedRunningTime="2026-09-10 22:22:50.184387828 +0000 UTC m=+276.768464867"
Sep 10 22:22:55.257296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:55.257260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:55.357716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:55.357682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:55.903082 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:55.903046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.104650 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.104620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.221302 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.221268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.304028 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.303994    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"]
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304260    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="pull"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304271    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="pull"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304283    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="util"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304288    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="util"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304295    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="extract"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304300    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="extract"
Sep 10 22:22:56.304383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.304349    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e81c6c-f8bb-4bf8-b7de-80f936cd43da" containerName="extract"
Sep 10 22:22:56.307411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.307393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.311887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.311867    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 22:22:56.312132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.312110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 22:22:56.312236 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.312175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qk85w\""
Sep 10 22:22:56.312955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.312937    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 22:22:56.313026 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.312988    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 22:22:56.326422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.326397    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"]
Sep 10 22:22:56.425990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.425963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.426125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.425994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.426125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.426012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.426125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.426044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.426233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.426123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kv4\" (UniqueName: \"kubernetes.io/projected/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-kube-api-access-j6kv4\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.473550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.473462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.526614 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.526591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kv4\" (UniqueName: \"kubernetes.io/projected/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-kube-api-access-j6kv4\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.526726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.526641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.526726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.526661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.526726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.526686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.526875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.526725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.527021 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.527004    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.529013 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.528982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.529112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.529065    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.529112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.529105    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.534801 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.534780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kv4\" (UniqueName: \"kubernetes.io/projected/bbef61e3-a102-49a1-b075-bb8d8dbcfda2-kube-api-access-j6kv4\") pod \"opendatahub-operator-controller-manager-7c969df88c-lf9h5\" (UID: \"bbef61e3-a102-49a1-b075-bb8d8dbcfda2\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.566419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.566389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.617407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.617382    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:22:56.667036 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.666971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.771284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.771219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.866639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.866610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:22:56.907094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:56.907076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"]
Sep 10 22:22:56.909755 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:22:56.909729    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbef61e3_a102_49a1_b075_bb8d8dbcfda2.slice/crio-4a9af709ed68dc30a89a9e47f53de9e72831cb35e01360bfcf303fd9797ed8e9 WatchSource:0}: Error finding container 4a9af709ed68dc30a89a9e47f53de9e72831cb35e01360bfcf303fd9797ed8e9: Status 404 returned error can't find the container with id 4a9af709ed68dc30a89a9e47f53de9e72831cb35e01360bfcf303fd9797ed8e9
Sep 10 22:22:57.194940 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:22:57.194867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5" event={"ID":"bbef61e3-a102-49a1-b075-bb8d8dbcfda2","Type":"ContainerStarted","Data":"4a9af709ed68dc30a89a9e47f53de9e72831cb35e01360bfcf303fd9797ed8e9"}
Sep 10 22:23:00.210565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:00.210521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5" event={"ID":"bbef61e3-a102-49a1-b075-bb8d8dbcfda2","Type":"ContainerStarted","Data":"9a566bfe12146353cdc31effc71fa824a4966ec1ca5f4fabf047adc00bc50783"}
Sep 10 22:23:01.173846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:01.173820    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-fs4bp"
Sep 10 22:23:01.216716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:01.216682    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbef61e3-a102-49a1-b075-bb8d8dbcfda2" containerID="9a566bfe12146353cdc31effc71fa824a4966ec1ca5f4fabf047adc00bc50783" exitCode=0
Sep 10 22:23:01.217097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:01.216728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5" event={"ID":"bbef61e3-a102-49a1-b075-bb8d8dbcfda2","Type":"ContainerDied","Data":"9a566bfe12146353cdc31effc71fa824a4966ec1ca5f4fabf047adc00bc50783"}
Sep 10 22:23:02.222655 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:02.222622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5" event={"ID":"bbef61e3-a102-49a1-b075-bb8d8dbcfda2","Type":"ContainerStarted","Data":"4533135503f104f45ee1b472bff5a1e57cfc0a6beafa451d0e4914bc1d2f7a00"}
Sep 10 22:23:02.223071 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:02.222783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:23:02.247064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:02.247018    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5" podStartSLOduration=1.879271709 podStartE2EDuration="6.247005226s" totalImagesPullingTime="3.31212716s" totalInitContainerRuntime="1.055606357s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:02.244957843 +0000 UTC m=+288.829034883" watchObservedRunningTime="2026-09-10 22:23:02.247005226 +0000 UTC m=+288.831082330"
Sep 10 22:23:13.229000 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:13.228964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-lf9h5"
Sep 10 22:23:13.781357 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:13.781329    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 22:23:14.756410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:14.756381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:14.874625 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:14.874597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:15.268722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.268686    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"]
Sep 10 22:23:15.317765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.317737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"]
Sep 10 22:23:15.317900 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.317819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.326723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.326701    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 22:23:15.327555 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.327537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 22:23:15.327680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.327583    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7rppj\""
Sep 10 22:23:15.327680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.327633    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 22:23:15.327680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.327650    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 22:23:15.470380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.470356    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsbwc\" (UniqueName: \"kubernetes.io/projected/9deba328-11d2-4c9e-a9f0-e86dc19e367a-kube-api-access-nsbwc\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.470529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.470407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tmp\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.470529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.470469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tls-certs\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.571394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.571328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tmp\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.571394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.571377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tls-certs\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.571681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.571419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsbwc\" (UniqueName: \"kubernetes.io/projected/9deba328-11d2-4c9e-a9f0-e86dc19e367a-kube-api-access-nsbwc\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.573605 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.573580    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tmp\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.573716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.573700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9deba328-11d2-4c9e-a9f0-e86dc19e367a-tls-certs\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.580647 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.580629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsbwc\" (UniqueName: \"kubernetes.io/projected/9deba328-11d2-4c9e-a9f0-e86dc19e367a-kube-api-access-nsbwc\") pod \"kube-auth-proxy-54fc6bbcb5-89gwd\" (UID: \"9deba328-11d2-4c9e-a9f0-e86dc19e367a\") " pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.626565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.626543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"
Sep 10 22:23:15.929271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.929187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd"]
Sep 10 22:23:15.934476 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:23:15.934451    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9deba328_11d2_4c9e_a9f0_e86dc19e367a.slice/crio-136d8d46fc3cba74bfbc2fb925c1f2c1ac0019b9b82841147a04bfe977e74ee8 WatchSource:0}: Error finding container 136d8d46fc3cba74bfbc2fb925c1f2c1ac0019b9b82841147a04bfe977e74ee8: Status 404 returned error can't find the container with id 136d8d46fc3cba74bfbc2fb925c1f2c1ac0019b9b82841147a04bfe977e74ee8
Sep 10 22:23:15.936305 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:15.936290    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:23:16.209322 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:16.209291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:16.280396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:16.280365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd" event={"ID":"9deba328-11d2-4c9e-a9f0-e86dc19e367a","Type":"ContainerStarted","Data":"136d8d46fc3cba74bfbc2fb925c1f2c1ac0019b9b82841147a04bfe977e74ee8"}
Sep 10 22:23:16.637640 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:16.637558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:16.736968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:16.736894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:17.745542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:17.745445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:19.295137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:19.295107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd" event={"ID":"9deba328-11d2-4c9e-a9f0-e86dc19e367a","Type":"ContainerStarted","Data":"4cfa43a5ae9af8ba93b2f1dbd7d6ab43f9a226fa299861d7c8ebfb0ad022f0a8"}
Sep 10 22:23:19.312223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:19.312176    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd" podStartSLOduration=1.6420893699999999 podStartE2EDuration="4.312149716s" totalImagesPullingTime="2.670060346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:19.310909429 +0000 UTC m=+305.894986470" watchObservedRunningTime="2026-09-10 22:23:19.312149716 +0000 UTC m=+305.896226756"
Sep 10 22:23:21.269384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:21.269331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:21.370705 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:21.370676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:22.122585 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:22.122547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:22.197878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:22.197834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:22.297801 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:22.297771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:25.959014 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:25.958966    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:26.061749 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:26.061712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:26.160417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:26.160385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:26.438296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:26.438190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:26.550166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:26.550132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:26.889796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:26.889768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:35.589398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:35.589366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:35.709658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:35.709619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:35.813244 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:35.813209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:36.184087 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:36.184058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:36.890304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:36.890269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:37.037885 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:37.037859    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:23:37.133992 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:23:37.133953    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:26.840470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:26.840386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:26.929719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:26.929697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:32.514875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:32.514834    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:41.105610 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:41.105571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:41.910221 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:41.910189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:42.383658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:42.383633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:42.759529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:42.759475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:45.847912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:45.847875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:45.949184 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:45.949150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:46.371639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:46.371593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:47.389920 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:47.389889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:48.925228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:48.925195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:49.548526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:49.548477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:51.123440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:51.123408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:52.164554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:52.164521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:52.930725 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:52.930693    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:24:53.059907 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:53.059874    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:53.164238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:53.164204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:53.265963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:53.265939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:56.324388 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:56.324352    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:56.426317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:56.426289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:56.727749 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:56.727725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:56.798178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:56.798150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:57.115668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:57.115601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:24:57.216540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:24:57.216515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:05.904308 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:05.904273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:06.001582 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:06.001560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:06.310159 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:06.310127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:06.411210 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:06.411180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:06.926620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:06.926593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:07.027405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:07.027383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:08.739561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.739525    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"]
Sep 10 22:25:08.740561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.740536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:08.742605 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.742590    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.746889 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.746835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 22:25:08.748445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.747750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 22:25:08.748445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.747788    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 22:25:08.748445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.748355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 22:25:08.750537 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.750392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j749g\""
Sep 10 22:25:08.754787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.754762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"]
Sep 10 22:25:08.861119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.861094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7de729-ae34-44f8-8ca8-d9396321e379-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.861208 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.861138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a7de729-ae34-44f8-8ca8-d9396321e379-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.861208 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.861164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrtd\" (UniqueName: \"kubernetes.io/projected/9a7de729-ae34-44f8-8ca8-d9396321e379-kube-api-access-rmrtd\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.932946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.932924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:08.962013 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.961986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a7de729-ae34-44f8-8ca8-d9396321e379-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.962113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.962023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrtd\" (UniqueName: \"kubernetes.io/projected/9a7de729-ae34-44f8-8ca8-d9396321e379-kube-api-access-rmrtd\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.962113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.962089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7de729-ae34-44f8-8ca8-d9396321e379-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.962581 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.962564    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a7de729-ae34-44f8-8ca8-d9396321e379-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.964316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.964296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7de729-ae34-44f8-8ca8-d9396321e379-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:08.971126 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:08.971104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrtd\" (UniqueName: \"kubernetes.io/projected/9a7de729-ae34-44f8-8ca8-d9396321e379-kube-api-access-rmrtd\") pod \"kuadrant-console-plugin-fbdd4f445-rxr9x\" (UID: \"9a7de729-ae34-44f8-8ca8-d9396321e379\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:09.057350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:09.057307    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"
Sep 10 22:25:09.323927 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:09.323905    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x"]
Sep 10 22:25:09.325950 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:25:09.325924    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a7de729_ae34_44f8_8ca8_d9396321e379.slice/crio-cd11fe9d7eeed79b921b44e9d32a08cec53b6c9cee82631f540df7c4a4b45975 WatchSource:0}: Error finding container cd11fe9d7eeed79b921b44e9d32a08cec53b6c9cee82631f540df7c4a4b45975: Status 404 returned error can't find the container with id cd11fe9d7eeed79b921b44e9d32a08cec53b6c9cee82631f540df7c4a4b45975
Sep 10 22:25:09.716650 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:09.716623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:09.760524 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:09.760479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x" event={"ID":"9a7de729-ae34-44f8-8ca8-d9396321e379","Type":"ContainerStarted","Data":"cd11fe9d7eeed79b921b44e9d32a08cec53b6c9cee82631f540df7c4a4b45975"}
Sep 10 22:25:09.817228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:09.817203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:11.978940 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:11.978880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:12.035121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:12.035089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:13.778910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:13.778880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x" event={"ID":"9a7de729-ae34-44f8-8ca8-d9396321e379","Type":"ContainerStarted","Data":"835986605d01cd761939155b2c2b8626b370396a95f8ca350dbea40e627e43e3"}
Sep 10 22:25:13.797268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:13.797227    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rxr9x" podStartSLOduration=1.4335189050000001 podStartE2EDuration="5.797211846s" totalImagesPullingTime="4.363692941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:13.796125881 +0000 UTC m=+420.380202922" watchObservedRunningTime="2026-09-10 22:25:13.797211846 +0000 UTC m=+420.381288884"
Sep 10 22:25:17.952610 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:17.952556    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-776fb744c7-nn47s" podUID="ac42f86d-5200-428d-be4c-793a4cf4ec88" containerName="console" containerID="cri-o://82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89" gracePeriod=15
Sep 10 22:25:18.191825 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.191800    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:25:18.338681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338618    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.338681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338653    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.338681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338669    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.338914 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.338914 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338721    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.339021 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.339021 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.338954    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj\") pod \"ac42f86d-5200-428d-be4c-793a4cf4ec88\" (UID: \"ac42f86d-5200-428d-be4c-793a4cf4ec88\") "
Sep 10 22:25:18.339113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339075    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:25:18.339113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339084    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca" (OuterVolumeSpecName: "service-ca") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:25:18.339113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:25:18.339318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339298    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.339318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339320    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-oauth-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.339456 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339323    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config" (OuterVolumeSpecName: "console-config") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:25:18.339456 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.339333    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-trusted-ca-bundle\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.340890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.340870    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj" (OuterVolumeSpecName: "kube-api-access-tnprj") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "kube-api-access-tnprj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:25:18.341179 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.341154    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:25:18.341179 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.341167    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ac42f86d-5200-428d-be4c-793a4cf4ec88" (UID: "ac42f86d-5200-428d-be4c-793a4cf4ec88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:25:18.440440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.440417    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-oauth-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.440440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.440436    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-serving-cert\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.440584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.440446    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac42f86d-5200-428d-be4c-793a4cf4ec88-console-config\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.440584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.440455    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/ac42f86d-5200-428d-be4c-793a4cf4ec88-kube-api-access-tnprj\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:25:18.799727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.799701    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac42f86d-5200-428d-be4c-793a4cf4ec88" containerID="82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89" exitCode=0
Sep 10 22:25:18.799859 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.799743    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776fb744c7-nn47s"
Sep 10 22:25:18.799859 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.799798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776fb744c7-nn47s" event={"ID":"ac42f86d-5200-428d-be4c-793a4cf4ec88","Type":"ContainerDied","Data":"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"}
Sep 10 22:25:18.799859 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.799848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776fb744c7-nn47s" event={"ID":"ac42f86d-5200-428d-be4c-793a4cf4ec88","Type":"ContainerDied","Data":"5e31710446349421d22fa3f7109b922481e37382a565e780ac44e354659a53fb"}
Sep 10 22:25:18.799966 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.799872    2559 scope.go:117] "RemoveContainer" containerID="82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"
Sep 10 22:25:18.808443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.808427    2559 scope.go:117] "RemoveContainer" containerID="82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"
Sep 10 22:25:18.808705 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:25:18.808686    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89\": container with ID starting with 82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89 not found: ID does not exist" containerID="82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"
Sep 10 22:25:18.808793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.808711    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89"} err="failed to get container status \"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89\": rpc error: code = NotFound desc = could not find container \"82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89\": container with ID starting with 82edc7c89bd9db9710d3f92e1e0e43caf63eb61d64a2b7c0ce65b5f643380d89 not found: ID does not exist"
Sep 10 22:25:18.852443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.852421    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:25:18.857854 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:18.857833    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776fb744c7-nn47s"]
Sep 10 22:25:19.017039 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.017007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.141832 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.141762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.359504 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.359453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.465163 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.465131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.559639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.559606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.659946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.659920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:19.890073 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:19.890010    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac42f86d-5200-428d-be4c-793a4cf4ec88" path="/var/lib/kubelet/pods/ac42f86d-5200-428d-be4c-793a4cf4ec88/volumes"
Sep 10 22:25:27.944293 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:27.944261    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:28.042708 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:28.042685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:30.945650 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:30.945611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:31.046999 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:31.046972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:33.401223 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:33.401187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:33.501006 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:33.500969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:34.081422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:34.081390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:34.182739 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:34.182715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:52.356450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:52.356402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:25:52.447928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:25:52.447892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:08.224062 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.224026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:08.326270 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.326225    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:08.385103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.385070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:08.607303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.607241    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:26:08.607547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.607533    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac42f86d-5200-428d-be4c-793a4cf4ec88" containerName="console"
Sep 10 22:26:08.607547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.607548    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac42f86d-5200-428d-be4c-793a4cf4ec88" containerName="console"
Sep 10 22:26:08.607657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.607606    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac42f86d-5200-428d-be4c-793a4cf4ec88" containerName="console"
Sep 10 22:26:08.610295 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.610281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.612740 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.612723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 22:26:08.620318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.620294    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:26:08.656412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.656390    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:26:08.673358 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.673334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f37440-2fc0-4833-99a2-09ca025922cd-config-file\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.673421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.673371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gz6\" (UniqueName: \"kubernetes.io/projected/b6f37440-2fc0-4833-99a2-09ca025922cd-kube-api-access-q9gz6\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.774203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.774183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gz6\" (UniqueName: \"kubernetes.io/projected/b6f37440-2fc0-4833-99a2-09ca025922cd-kube-api-access-q9gz6\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.774291 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.774277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f37440-2fc0-4833-99a2-09ca025922cd-config-file\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.774865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.774849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f37440-2fc0-4833-99a2-09ca025922cd-config-file\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.781778 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.781754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gz6\" (UniqueName: \"kubernetes.io/projected/b6f37440-2fc0-4833-99a2-09ca025922cd-kube-api-access-q9gz6\") pod \"limitador-limitador-84994f7ffc-cbw79\" (UID: \"b6f37440-2fc0-4833-99a2-09ca025922cd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:08.919872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:08.919817    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:09.022566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.022537    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:09.026071 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.026052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:09.028483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.028466    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jmpbc\""
Sep 10 22:26:09.031762 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.031723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:09.052624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.052604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:09.076819 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.076797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rtx\" (UniqueName: \"kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx\") pod \"authorino-7bcfd8f9cd-q9nfc\" (UID: \"785987ed-0dc4-4b01-a20c-c9e3dc69840b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:09.143572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.143552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:09.177368 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.177309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rtx\" (UniqueName: \"kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx\") pod \"authorino-7bcfd8f9cd-q9nfc\" (UID: \"785987ed-0dc4-4b01-a20c-c9e3dc69840b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:09.185461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.185440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rtx\" (UniqueName: \"kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx\") pod \"authorino-7bcfd8f9cd-q9nfc\" (UID: \"785987ed-0dc4-4b01-a20c-c9e3dc69840b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:09.191678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.191655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:26:09.193269 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:26:09.193248    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f37440_2fc0_4833_99a2_09ca025922cd.slice/crio-0f58294f137d7e39544e987d0643b12791e9b74aa1e0b7a2d9a0fdcab32ce493 WatchSource:0}: Error finding container 0f58294f137d7e39544e987d0643b12791e9b74aa1e0b7a2d9a0fdcab32ce493: Status 404 returned error can't find the container with id 0f58294f137d7e39544e987d0643b12791e9b74aa1e0b7a2d9a0fdcab32ce493
Sep 10 22:26:09.336470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.336439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:09.601830 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.601801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:09.604405 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:26:09.604382    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod785987ed_0dc4_4b01_a20c_c9e3dc69840b.slice/crio-953a1fff58ddbc1e5478ab5744f5f7a9c317f1becb79e8e70f9796eb0389faa2 WatchSource:0}: Error finding container 953a1fff58ddbc1e5478ab5744f5f7a9c317f1becb79e8e70f9796eb0389faa2: Status 404 returned error can't find the container with id 953a1fff58ddbc1e5478ab5744f5f7a9c317f1becb79e8e70f9796eb0389faa2
Sep 10 22:26:09.997187 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.997157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79" event={"ID":"b6f37440-2fc0-4833-99a2-09ca025922cd","Type":"ContainerStarted","Data":"0f58294f137d7e39544e987d0643b12791e9b74aa1e0b7a2d9a0fdcab32ce493"}
Sep 10 22:26:09.998539 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:09.998510    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" event={"ID":"785987ed-0dc4-4b01-a20c-c9e3dc69840b","Type":"ContainerStarted","Data":"953a1fff58ddbc1e5478ab5744f5f7a9c317f1becb79e8e70f9796eb0389faa2"}
Sep 10 22:26:12.010112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.010075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79" event={"ID":"b6f37440-2fc0-4833-99a2-09ca025922cd","Type":"ContainerStarted","Data":"8d3dcbb322f2d3cb90be6ad9ca4c0d033895420c78e1fb4dd1a27c335e6e7138"}
Sep 10 22:26:12.010547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.010216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:12.012199 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.012173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" event={"ID":"785987ed-0dc4-4b01-a20c-c9e3dc69840b","Type":"ContainerStarted","Data":"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"}
Sep 10 22:26:12.043592 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.043539    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79" podStartSLOduration=1.382347089 podStartE2EDuration="4.043519889s" totalImagesPullingTime="2.6611728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:12.041904558 +0000 UTC m=+478.625981597" watchObservedRunningTime="2026-09-10 22:26:12.043519889 +0000 UTC m=+478.627596929"
Sep 10 22:26:12.072193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.072151    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" podStartSLOduration=0.813449279 podStartE2EDuration="3.072137905s" totalImagesPullingTime="2.258688626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:12.070543656 +0000 UTC m=+478.654620695" watchObservedRunningTime="2026-09-10 22:26:12.072137905 +0000 UTC m=+478.656214943"
Sep 10 22:26:12.127722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:12.127660    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:14.019575 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:14.019540    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" podUID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" containerName="authorino" containerID="cri-o://f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc" gracePeriod=30
Sep 10 22:26:14.255200 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:14.255178    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:14.316202 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:14.316181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4rtx\" (UniqueName: \"kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx\") pod \"785987ed-0dc4-4b01-a20c-c9e3dc69840b\" (UID: \"785987ed-0dc4-4b01-a20c-c9e3dc69840b\") "
Sep 10 22:26:14.318116 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:14.318094    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx" (OuterVolumeSpecName: "kube-api-access-f4rtx") pod "785987ed-0dc4-4b01-a20c-c9e3dc69840b" (UID: "785987ed-0dc4-4b01-a20c-c9e3dc69840b"). InnerVolumeSpecName "kube-api-access-f4rtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:14.417649 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:14.417598    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4rtx\" (UniqueName: \"kubernetes.io/projected/785987ed-0dc4-4b01-a20c-c9e3dc69840b-kube-api-access-f4rtx\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:26:15.024175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.024139    2559 generic.go:356] "Generic (PLEG): container finished" podID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" containerID="f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc" exitCode=0
Sep 10 22:26:15.024563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.024182    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc"
Sep 10 22:26:15.024563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.024224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" event={"ID":"785987ed-0dc4-4b01-a20c-c9e3dc69840b","Type":"ContainerDied","Data":"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"}
Sep 10 22:26:15.024563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.024265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-q9nfc" event={"ID":"785987ed-0dc4-4b01-a20c-c9e3dc69840b","Type":"ContainerDied","Data":"953a1fff58ddbc1e5478ab5744f5f7a9c317f1becb79e8e70f9796eb0389faa2"}
Sep 10 22:26:15.024563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.024281    2559 scope.go:117] "RemoveContainer" containerID="f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"
Sep 10 22:26:15.032222 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.032208    2559 scope.go:117] "RemoveContainer" containerID="f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"
Sep 10 22:26:15.032476 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:26:15.032456    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc\": container with ID starting with f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc not found: ID does not exist" containerID="f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"
Sep 10 22:26:15.032542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.032484    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc"} err="failed to get container status \"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc\": rpc error: code = NotFound desc = could not find container \"f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc\": container with ID starting with f145df0a62fd90516eacd8e0a039360def81eef090f2be0e08c0b677abd1fcdc not found: ID does not exist"
Sep 10 22:26:15.048680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.048657    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:15.050001 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.049980    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-q9nfc"]
Sep 10 22:26:15.890896 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:15.890856    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" path="/var/lib/kubelet/pods/785987ed-0dc4-4b01-a20c-c9e3dc69840b/volumes"
Sep 10 22:26:23.017327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:23.017300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-cbw79"
Sep 10 22:26:26.398424 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:26.398387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:26.487636 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:26.487606    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:26.843925 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:26.843893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:38.888656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:38.888623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:38.984409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:38.984371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:45.960207 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:45.960161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:46.051660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:46.051630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:46.131294 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:46.131265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:46.218973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:46.218901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:49.106306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:49.106277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:26:49.203278 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:26:49.203244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:20.795667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:20.795631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:20.958144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:20.958098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.264098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.264065    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.364821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.364765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.468791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.468749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.740752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.740725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.871274 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.871242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:22.969561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:22.969526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:23.066565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:23.066450    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:27:33.359960 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:33.359917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:33.474945 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:33.474909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.177831 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:42.177775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:42.753955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:42.753923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:27:49.566269 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:49.566230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:27:49.947790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:49.947710    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:27:59.896766 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:27:59.896731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:02.453646 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:02.453616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:02.554031 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:02.553998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:05.936107 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.936075    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"]
Sep 10 22:28:05.936453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.936347    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" containerName="authorino"
Sep 10 22:28:05.936453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.936358    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" containerName="authorino"
Sep 10 22:28:05.936453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.936420    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="785987ed-0dc4-4b01-a20c-c9e3dc69840b" containerName="authorino"
Sep 10 22:28:05.939387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.939367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:05.942033 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.942012    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 22:28:05.943068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.943049    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 22:28:05.943275 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.943262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m62lm\""
Sep 10 22:28:05.943342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.943327    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 22:28:05.950518 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.950463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"]
Sep 10 22:28:05.975796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:05.975769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:06.033130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.033229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.033229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.033316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9bp\" (UniqueName: \"kubernetes.io/projected/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-kube-api-access-xh9bp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.033316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.033392 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.033316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.133931 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.133908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.133932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.133959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.133985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.134017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.134035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9bp\" (UniqueName: \"kubernetes.io/projected/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-kube-api-access-xh9bp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.134324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.134336    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.134453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.134400    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.136158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.136139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.136383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.136367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.142581 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.142559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9bp\" (UniqueName: \"kubernetes.io/projected/d1bbaa97-94f6-4629-b181-2d7f868ae6c2-kube-api-access-xh9bp\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7\" (UID: \"d1bbaa97-94f6-4629-b181-2d7f868ae6c2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.249820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.249798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:06.518596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.518519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"]
Sep 10 22:28:06.521529 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:28:06.521462    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bbaa97_94f6_4629_b181_2d7f868ae6c2.slice/crio-96ebb92ac2e28b2dfe5cc4b934e9753da848218407348907030d577c48ac28af WatchSource:0}: Error finding container 96ebb92ac2e28b2dfe5cc4b934e9753da848218407348907030d577c48ac28af: Status 404 returned error can't find the container with id 96ebb92ac2e28b2dfe5cc4b934e9753da848218407348907030d577c48ac28af
Sep 10 22:28:06.977402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:06.977362    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:28:07.485793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:07.485762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7" event={"ID":"d1bbaa97-94f6-4629-b181-2d7f868ae6c2","Type":"ContainerStarted","Data":"96ebb92ac2e28b2dfe5cc4b934e9753da848218407348907030d577c48ac28af"}
Sep 10 22:28:08.491598 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:08.491563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7" event={"ID":"d1bbaa97-94f6-4629-b181-2d7f868ae6c2","Type":"ContainerStarted","Data":"cccc2af1bacc445fabcc5ad87de4fe7f38a5c44ed305498ee8e5f6a573442275"}
Sep 10 22:28:08.510791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:08.510747    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7" podStartSLOduration=2.564404126 podStartE2EDuration="3.510731889s" totalImagesPullingTime="946.327763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:08.509533172 +0000 UTC m=+595.093610210" watchObservedRunningTime="2026-09-10 22:28:08.510731889 +0000 UTC m=+595.094808927"
Sep 10 22:28:16.250675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:16.250625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:16.250675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:16.250693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:16.262566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:16.262546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:16.535250 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:16.535163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7"
Sep 10 22:28:16.939857 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:16.939780    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:18.749729 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:18.749692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:20.252200 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.252169    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"]
Sep 10 22:28:20.255171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.255156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.257635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.257617    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 22:28:20.264678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.264655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"]
Sep 10 22:28:20.340297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.340263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:20.343323 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.343395 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.343395 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13c67ef-8b44-46a7-b387-ecf887a18882-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.343508 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.343571 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.343622 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.343577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2nv\" (UniqueName: \"kubernetes.io/projected/a13c67ef-8b44-46a7-b387-ecf887a18882-kube-api-access-zw2nv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2nv\" (UniqueName: \"kubernetes.io/projected/a13c67ef-8b44-46a7-b387-ecf887a18882-kube-api-access-zw2nv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13c67ef-8b44-46a7-b387-ecf887a18882-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444468 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444618 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444574    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.444618 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.444605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.446462 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.446436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13c67ef-8b44-46a7-b387-ecf887a18882-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.446733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.446716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13c67ef-8b44-46a7-b387-ecf887a18882-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.451579 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.451556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2nv\" (UniqueName: \"kubernetes.io/projected/a13c67ef-8b44-46a7-b387-ecf887a18882-kube-api-access-zw2nv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t2qlv\" (UID: \"a13c67ef-8b44-46a7-b387-ecf887a18882\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.564476 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.564414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:20.832405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.832363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"]
Sep 10 22:28:20.834565 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:28:20.834540    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13c67ef_8b44_46a7_b387_ecf887a18882.slice/crio-e718609fb0e61ff2eca5da470a04ad44d23e22864459892dae798fa7079f949e WatchSource:0}: Error finding container e718609fb0e61ff2eca5da470a04ad44d23e22864459892dae798fa7079f949e: Status 404 returned error can't find the container with id e718609fb0e61ff2eca5da470a04ad44d23e22864459892dae798fa7079f949e
Sep 10 22:28:20.836308 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:20.836292    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:28:21.544806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:21.544774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv" event={"ID":"a13c67ef-8b44-46a7-b387-ecf887a18882","Type":"ContainerStarted","Data":"8d2170ed49c5f28bfa08efcea04ef0ccc14f5f33ef70c6bca0cbdfb9c3db29a0"}
Sep 10 22:28:21.545147 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:21.544829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv" event={"ID":"a13c67ef-8b44-46a7-b387-ecf887a18882","Type":"ContainerStarted","Data":"e718609fb0e61ff2eca5da470a04ad44d23e22864459892dae798fa7079f949e"}
Sep 10 22:28:21.562662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:21.562616    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv" podStartSLOduration=1.40076105 podStartE2EDuration="1.562602221s" totalImagesPullingTime="161.841171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:21.561356735 +0000 UTC m=+608.145433768" watchObservedRunningTime="2026-09-10 22:28:21.562602221 +0000 UTC m=+608.146679260"
Sep 10 22:28:21.636500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:21.636463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:28:27.636680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.636643    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"]
Sep 10 22:28:27.642848 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.642826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.645577 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.645559    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 22:28:27.650672 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.650644    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"]
Sep 10 22:28:27.686660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.686637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:27.801239 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.801239 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.801396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n8kn\" (UniqueName: \"kubernetes.io/projected/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-kube-api-access-2n8kn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.801396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.801530 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.801530 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.801465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.901967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.901914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n8kn\" (UniqueName: \"kubernetes.io/projected/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-kube-api-access-2n8kn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.901967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.901945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.901966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902527 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.902527 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.902471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.904166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.904149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.904431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.904412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.910028 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.910006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n8kn\" (UniqueName: \"kubernetes.io/projected/ad193d1e-fdf5-403b-82d7-a70ee4771ae5-kube-api-access-2n8kn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj\" (UID: \"ad193d1e-fdf5-403b-82d7-a70ee4771ae5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:27.955355 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:27.955337    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:28.225237 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:28.225216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"]
Sep 10 22:28:28.227352 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:28:28.227325    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad193d1e_fdf5_403b_82d7_a70ee4771ae5.slice/crio-939f06d99623cc4de27f19da84bc9b94a9d1027d03a15f6834f32dc1bde3b095 WatchSource:0}: Error finding container 939f06d99623cc4de27f19da84bc9b94a9d1027d03a15f6834f32dc1bde3b095: Status 404 returned error can't find the container with id 939f06d99623cc4de27f19da84bc9b94a9d1027d03a15f6834f32dc1bde3b095
Sep 10 22:28:28.575060 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:28.574977    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj" event={"ID":"ad193d1e-fdf5-403b-82d7-a70ee4771ae5","Type":"ContainerStarted","Data":"b443c6f00b61c1188fcf64f33929a71f460a154cdc0204e289cd3de0216f2415"}
Sep 10 22:28:28.575060 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:28.575036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj" event={"ID":"ad193d1e-fdf5-403b-82d7-a70ee4771ae5","Type":"ContainerStarted","Data":"939f06d99623cc4de27f19da84bc9b94a9d1027d03a15f6834f32dc1bde3b095"}
Sep 10 22:28:28.595383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:28.595331    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj" podStartSLOduration=1.4028439160000001 podStartE2EDuration="1.595312881s" totalImagesPullingTime="192.468965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:28.594882527 +0000 UTC m=+615.178959568" watchObservedRunningTime="2026-09-10 22:28:28.595312881 +0000 UTC m=+615.179389922"
Sep 10 22:28:29.354623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:29.354590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:28:30.565424 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:30.565387    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:30.565784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:30.565450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:30.577287 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:30.577261    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:30.594470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:30.594451    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t2qlv"
Sep 10 22:28:32.543862 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.543830    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"]
Sep 10 22:28:32.547858 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.547838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.550841 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.550823    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 22:28:32.563361 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.563341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"]
Sep 10 22:28:32.576297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.576274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:32.736652 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.736779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvzv\" (UniqueName: \"kubernetes.io/projected/e34803d9-c1b7-4a97-80a8-ae40e34189b3-kube-api-access-dcvzv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.736779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.736779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.736779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.736928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.736833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.837970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.837911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.837970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.837939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvzv\" (UniqueName: \"kubernetes.io/projected/e34803d9-c1b7-4a97-80a8-ae40e34189b3-kube-api-access-dcvzv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.837970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.837966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.837993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.838014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.838046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838357 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.838323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838418 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.838378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.838466 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.838439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.840145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.840118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e34803d9-c1b7-4a97-80a8-ae40e34189b3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.840531 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.840511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e34803d9-c1b7-4a97-80a8-ae40e34189b3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.846571 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.846551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvzv\" (UniqueName: \"kubernetes.io/projected/e34803d9-c1b7-4a97-80a8-ae40e34189b3-kube-api-access-dcvzv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-946q4\" (UID: \"e34803d9-c1b7-4a97-80a8-ae40e34189b3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:32.858262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:32.858247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:33.145563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:33.145470    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"]
Sep 10 22:28:33.147897 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:28:33.147871    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34803d9_c1b7_4a97_80a8_ae40e34189b3.slice/crio-d87c2134cf9c1c83a3568bea6bd79f9a57be6fb4794f3e61bb097828f4985b3f WatchSource:0}: Error finding container d87c2134cf9c1c83a3568bea6bd79f9a57be6fb4794f3e61bb097828f4985b3f: Status 404 returned error can't find the container with id d87c2134cf9c1c83a3568bea6bd79f9a57be6fb4794f3e61bb097828f4985b3f
Sep 10 22:28:33.597617 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:33.597577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4" event={"ID":"e34803d9-c1b7-4a97-80a8-ae40e34189b3","Type":"ContainerStarted","Data":"6679a958c41a1ae8bf26c0c2a83450183c7891158d2c6601f75b478e15063142"}
Sep 10 22:28:33.598097 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:33.597631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4" event={"ID":"e34803d9-c1b7-4a97-80a8-ae40e34189b3","Type":"ContainerStarted","Data":"d87c2134cf9c1c83a3568bea6bd79f9a57be6fb4794f3e61bb097828f4985b3f"}
Sep 10 22:28:33.614778 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:33.614721    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4" podStartSLOduration=1.438244297 podStartE2EDuration="1.614708209s" totalImagesPullingTime="176.463912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:33.612683225 +0000 UTC m=+620.196760263" watchObservedRunningTime="2026-09-10 22:28:33.614708209 +0000 UTC m=+620.198785247"
Sep 10 22:28:34.452880 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:34.452850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:28:37.956438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:37.956365    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:37.956798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:37.956439    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:37.968363 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:37.968344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:38.634549 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:38.634519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj"
Sep 10 22:28:41.894280 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:41.894249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:41.995520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:41.995453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:42.859282 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:42.859241    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:42.859458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:42.859305    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:42.871177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:42.871156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:43.656508 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:43.656466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-946q4"
Sep 10 22:28:44.843926 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.843894    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"]
Sep 10 22:28:44.847454 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.847433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.849962 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.849943    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 10 22:28:44.858307 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.858286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"]
Sep 10 22:28:44.885502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.885458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:28:44.926761 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926735    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.926869 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.926869 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.926869 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.926970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hfj\" (UniqueName: \"kubernetes.io/projected/341b2533-b8fe-4e64-8c1e-38e02930418f-kube-api-access-c6hfj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:44.926970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:44.926947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/341b2533-b8fe-4e64-8c1e-38e02930418f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hfj\" (UniqueName: \"kubernetes.io/projected/341b2533-b8fe-4e64-8c1e-38e02930418f-kube-api-access-c6hfj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/341b2533-b8fe-4e64-8c1e-38e02930418f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028555 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028638 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.028695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.028649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.030303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.030288    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/341b2533-b8fe-4e64-8c1e-38e02930418f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.030682 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.030666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/341b2533-b8fe-4e64-8c1e-38e02930418f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.036159 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.036136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hfj\" (UniqueName: \"kubernetes.io/projected/341b2533-b8fe-4e64-8c1e-38e02930418f-kube-api-access-c6hfj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx\" (UID: \"341b2533-b8fe-4e64-8c1e-38e02930418f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.158519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.158429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:45.425166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.425143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"]
Sep 10 22:28:45.427049 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:28:45.427023    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod341b2533_b8fe_4e64_8c1e_38e02930418f.slice/crio-3f4cb7bab2a19c4f09ebf1246ec0fe1f695182cf3c1b30332ab43602645e55db WatchSource:0}: Error finding container 3f4cb7bab2a19c4f09ebf1246ec0fe1f695182cf3c1b30332ab43602645e55db: Status 404 returned error can't find the container with id 3f4cb7bab2a19c4f09ebf1246ec0fe1f695182cf3c1b30332ab43602645e55db
Sep 10 22:28:45.655572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:45.655540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx" event={"ID":"341b2533-b8fe-4e64-8c1e-38e02930418f","Type":"ContainerStarted","Data":"3f4cb7bab2a19c4f09ebf1246ec0fe1f695182cf3c1b30332ab43602645e55db"}
Sep 10 22:28:46.661528 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:46.661485    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx" event={"ID":"341b2533-b8fe-4e64-8c1e-38e02930418f","Type":"ContainerStarted","Data":"be59bbdb7d4cb58548f6ff2b0ed957f3772ccc78a168f54e46dfdb58bdc16c54"}
Sep 10 22:28:46.681314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:46.681267    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx" podStartSLOduration=2.499278438 podStartE2EDuration="2.681251676s" totalImagesPullingTime="181.973238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:28:46.679185657 +0000 UTC m=+633.263262712" watchObservedRunningTime="2026-09-10 22:28:46.681251676 +0000 UTC m=+633.265328715"
Sep 10 22:28:47.148354 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:47.148318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:28:55.159420 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:55.159372    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:55.159885 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:55.159438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:55.171634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:55.171609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:28:55.719463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:28:55.719433    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx"
Sep 10 22:29:46.596000 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:29:46.595963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:46.704720 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:29:46.704683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:47.711458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:29:47.711423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:29:47.810936 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:29:47.810893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:02.870157 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:02.870123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:03.005422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:03.005394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:03.287645 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:03.287607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:03.616352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:03.616271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:04.237884 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:04.237840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:04.337596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:04.337552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:04.674161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:04.674081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:04.953976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:04.953942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:30:06.127256 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:06.127223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:06.220116 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:06.220049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.091480 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.091440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.327415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.327379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.427406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.427318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.528107 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.528071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.826134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.826105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:07.895772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:07.895738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:10.269528 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:10.269484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:10.577984 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:10.577908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:10.692612 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:10.692575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:10.834257 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:10.834175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:10.972504 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:10.972451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:11.280317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:11.280274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:11.505171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:11.505134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:13.576211 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:13.576173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:13.671348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:13.671313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.126538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:14.126481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.226272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:14.226241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.841718 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:14.841653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:14.914713 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:14.914680    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.183137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.183054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.386247 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.386215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.484873 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.484846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.714910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.714877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.790278 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.790196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:15.917591 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:15.917560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.130592 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.130509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.206870 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.206831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.310030 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.310000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.686419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.686380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.788143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.788110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:16.989171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.989137    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:30:16.992263 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.992243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:16.994799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.994783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-cc3245-dockercfg-whjlm\""
Sep 10 22:30:16.995016 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:16.995002    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-cc3245\""
Sep 10 22:30:17.004803 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.004781    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:30:17.062160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.062130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gns\" (UniqueName: \"kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.062296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.062196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.162906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.162874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.163067 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.162933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gns\" (UniqueName: \"kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.163623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.163597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.171091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.171070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gns\" (UniqueName: \"kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns\") pod \"payload-processing-e2e-autores-cc3245-558cd97bfc-926wx\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") " pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.274144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.274049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:17.302861 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.302834    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:17.574064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.574039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:30:17.576432 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:30:17.576407    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ece9d2c_16cb_48b3_ae4f_ab85caf966eb.slice/crio-2f2f3aa9cc20845c205919f2eecc5363943e7df5f3105f04fdb2eb2c013cd38b WatchSource:0}: Error finding container 2f2f3aa9cc20845c205919f2eecc5363943e7df5f3105f04fdb2eb2c013cd38b: Status 404 returned error can't find the container with id 2f2f3aa9cc20845c205919f2eecc5363943e7df5f3105f04fdb2eb2c013cd38b
Sep 10 22:30:17.945330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:17.945252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:30:18.009104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:18.009047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:18.051978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:18.051909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" event={"ID":"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb","Type":"ContainerStarted","Data":"2f2f3aa9cc20845c205919f2eecc5363943e7df5f3105f04fdb2eb2c013cd38b"}
Sep 10 22:30:20.061895 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:20.061858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" event={"ID":"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb","Type":"ContainerStarted","Data":"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"}
Sep 10 22:30:20.062317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:20.061990    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:20.078187 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:20.078144    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" podStartSLOduration=2.476230079 podStartE2EDuration="4.078130126s" totalImagesPullingTime="1.601900047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:20.076966483 +0000 UTC m=+726.661043523" watchObservedRunningTime="2026-09-10 22:30:20.078130126 +0000 UTC m=+726.662207165"
Sep 10 22:30:21.834648 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:21.834615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:21.938543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:21.938503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:22.040328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:22.040293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:22.193714 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:22.193609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:25.906218 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:25.906175    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:26.048375 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:26.048339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:26.147974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:26.147937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:26.288469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:26.288429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:28.138392 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:28.138357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:28.239232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:28.239194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:28.338577 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:28.338544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:28.908245 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:28.908211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:29.134563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.134526    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:30:29.143542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.143515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.146442 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.146398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-481dd50d-kserve-self-signed-certs\""
Sep 10 22:30:29.147591 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.147567    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:30:29.268988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.268941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.269146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.269002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrm9\" (UniqueName: \"kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.269146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.269050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.269146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.269097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.269146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.269123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.269314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.269196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370534 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrm9\" (UniqueName: \"kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.370975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.370962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.371173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.371149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.372927 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.372904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.373292 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.373272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.378750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.378725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrm9\" (UniqueName: \"kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9\") pod \"e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") " pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.433634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.433602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:29.453212 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.453183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:29.725334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:29.725307    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:30:29.727818 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:30:29.727786    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a5602b9_e43f_4248_9dce_3dd478e78151.slice/crio-54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736 WatchSource:0}: Error finding container 54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736: Status 404 returned error can't find the container with id 54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736
Sep 10 22:30:30.110675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:30.110584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" event={"ID":"5a5602b9-e43f-4248-9dce-3dd478e78151","Type":"ContainerStarted","Data":"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"}
Sep 10 22:30:30.110675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:30.110630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" event={"ID":"5a5602b9-e43f-4248-9dce-3dd478e78151","Type":"ContainerStarted","Data":"54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736"}
Sep 10 22:30:30.128231 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:30.128185    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" podStartSLOduration=1.128168393 podStartE2EDuration="1.128168393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:30.127416593 +0000 UTC m=+736.711493636" watchObservedRunningTime="2026-09-10 22:30:30.128168393 +0000 UTC m=+736.712245416"
Sep 10 22:30:30.504767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:30.504724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.019111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:31.019082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.068479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:31.068447    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:30:31.326842 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:31.326739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.631111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:31.630997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:31.747630 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:31.747588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:32.552023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:32.551988    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:30:35.366969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:35.366928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:35.457865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:35.457836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:35.879197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:35.879154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:36.746218 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:36.746176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:36.844732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:36.844697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:37.001093 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:37.001001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:37.237023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:37.236991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:37.340338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:37.340256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:37.736874 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:37.736836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:38.610822 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:38.610785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:38.992848 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:38.992819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"]
Sep 10 22:30:38.995963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:38.995944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:38.998346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:38.998330    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:30:38.998425 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:38.998414    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:30:39.003812 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.003790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"]
Sep 10 22:30:39.055791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.055756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j\" (UID: \"1ea13801-8a91-4134-b686-3cdf2a5e4f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:39.157056 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.157032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j\" (UID: \"1ea13801-8a91-4134-b686-3cdf2a5e4f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:39.157714 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.157692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j\" (UID: \"1ea13801-8a91-4134-b686-3cdf2a5e4f41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:39.307142 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.307084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:39.453406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.453376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:39.453562 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.453418    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:39.465534 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.465514    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:39.580604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.580578    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"]
Sep 10 22:30:39.582608 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:30:39.582582    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea13801_8a91_4134_b686_3cdf2a5e4f41.slice/crio-84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d WatchSource:0}: Error finding container 84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d: Status 404 returned error can't find the container with id 84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d
Sep 10 22:30:39.643663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:39.643634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:40.157215 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:40.157179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j" event={"ID":"1ea13801-8a91-4134-b686-3cdf2a5e4f41","Type":"ContainerStarted","Data":"84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d"}
Sep 10 22:30:40.168362 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:40.168344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:30:40.536217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:40.536183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:41.287296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:41.287251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:42.170438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:42.170345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j" event={"ID":"1ea13801-8a91-4134-b686-3cdf2a5e4f41","Type":"ContainerStarted","Data":"ec525669b38b5772573dfc43c7727745aea72aaa2f3ae7c95ddcc8f8773cb702"}
Sep 10 22:30:42.185928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:42.185878    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j" podStartSLOduration=2.233157908 podStartE2EDuration="4.185860475s" totalImagesPullingTime="1.952702567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:42.184948364 +0000 UTC m=+748.769025404" watchObservedRunningTime="2026-09-10 22:30:42.185860475 +0000 UTC m=+748.769937556"
Sep 10 22:30:43.176559 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:43.176523    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ea13801-8a91-4134-b686-3cdf2a5e4f41" containerID="ec525669b38b5772573dfc43c7727745aea72aaa2f3ae7c95ddcc8f8773cb702" exitCode=0
Sep 10 22:30:43.176919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:43.176600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j" event={"ID":"1ea13801-8a91-4134-b686-3cdf2a5e4f41","Type":"ContainerDied","Data":"ec525669b38b5772573dfc43c7727745aea72aaa2f3ae7c95ddcc8f8773cb702"}
Sep 10 22:30:44.153711 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:44.153677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:44.305837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:44.305813    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:44.401623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:44.401600    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca\") pod \"1ea13801-8a91-4134-b686-3cdf2a5e4f41\" (UID: \"1ea13801-8a91-4134-b686-3cdf2a5e4f41\") "
Sep 10 22:30:44.401917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:44.401895    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ea13801-8a91-4134-b686-3cdf2a5e4f41" (UID: "1ea13801-8a91-4134-b686-3cdf2a5e4f41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:44.502457 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:44.502432    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ea13801-8a91-4134-b686-3cdf2a5e4f41-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:30:45.186671 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:45.186645    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"
Sep 10 22:30:45.186671 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:45.186667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j" event={"ID":"1ea13801-8a91-4134-b686-3cdf2a5e4f41","Type":"ContainerDied","Data":"84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d"}
Sep 10 22:30:45.186914 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:45.186731    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84e0d7417779efb3a4eae7bf41bc6b0975cecea4f0c77f5b5f6d08532eb9f39d"
Sep 10 22:30:52.450148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:52.450113    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:30:54.936937 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:54.936902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.601963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.601928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.681016 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.680981    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.743824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.743788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.844122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.844082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:55.855820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.855744    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"]
Sep 10 22:30:55.857868 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.857848    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9005ccc0-9gd9j"]
Sep 10 22:30:55.891538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.891505    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea13801-8a91-4134-b686-3cdf2a5e4f41" path="/var/lib/kubelet/pods/1ea13801-8a91-4134-b686-3cdf2a5e4f41/volumes"
Sep 10 22:30:55.937143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:55.937102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:56.009537 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:56.009482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:56.444217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:56.444182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:56.531380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:56.531350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:56.633764 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:56.633724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:56.957870 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:56.957838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:57.486131 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:57.486097    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:30:57.722214 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:30:57.722161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:00.227036 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:00.227002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:02.660857 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:02.660824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:02.761929 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:02.761900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:02.906117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:02.906086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:03.010455 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.010419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:03.106771 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.106731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:03.485666 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.485631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:03.585454 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.585419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:03.599908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.599878    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:03.600225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.600213    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea13801-8a91-4134-b686-3cdf2a5e4f41" containerName="revoke-keys"
Sep 10 22:31:03.600280 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.600227    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea13801-8a91-4134-b686-3cdf2a5e4f41" containerName="revoke-keys"
Sep 10 22:31:03.600322 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.600296    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea13801-8a91-4134-b686-3cdf2a5e4f41" containerName="revoke-keys"
Sep 10 22:31:03.605676 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.605651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.608361 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.608335    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-2643d53e\""
Sep 10 22:31:03.608361 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.608359    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-2643d53e-dockercfg-2brbm\""
Sep 10 22:31:03.615299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.615275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:03.627933 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.627904    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:03.632292 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.632275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.652782 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.652753    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:03.668574 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.668550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.668883 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.668669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhg2t\" (UniqueName: \"kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.769700 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.769621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhg2t\" (UniqueName: \"kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.769700 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.769658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.769700 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.769693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.769918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.769777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn2r6\" (UniqueName: \"kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.770325 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.770302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.777660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.777634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhg2t\" (UniqueName: \"kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t\") pod \"payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.870687 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.870656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn2r6\" (UniqueName: \"kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.870854 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.870735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.871352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.871334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.878415 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.878390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn2r6\" (UniqueName: \"kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6\") pod \"payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") " pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:03.917443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.917416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:03.941439 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:03.941416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:04.194714 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.194684    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:04.196526 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:04.196480    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ae9b1b_734c_448b_8981_d141cdd2dfce.slice/crio-e1c8064be56047091c817ebb16c24a050a2a669cad442ce9e70a7a9f2392470c WatchSource:0}: Error finding container e1c8064be56047091c817ebb16c24a050a2a669cad442ce9e70a7a9f2392470c: Status 404 returned error can't find the container with id e1c8064be56047091c817ebb16c24a050a2a669cad442ce9e70a7a9f2392470c
Sep 10 22:31:04.226311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.226276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:04.228951 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:04.228931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d23263b_c401_41db_b9fa_1161b3693cd8.slice/crio-58b3a263134ca3255b9b86541f3be2561d04c750e4f044a9fadf28547a614285 WatchSource:0}: Error finding container 58b3a263134ca3255b9b86541f3be2561d04c750e4f044a9fadf28547a614285: Status 404 returned error can't find the container with id 58b3a263134ca3255b9b86541f3be2561d04c750e4f044a9fadf28547a614285
Sep 10 22:31:04.276677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.276648    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" event={"ID":"7d23263b-c401-41db-b9fa-1161b3693cd8","Type":"ContainerStarted","Data":"58b3a263134ca3255b9b86541f3be2561d04c750e4f044a9fadf28547a614285"}
Sep 10 22:31:04.278410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.278382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" event={"ID":"20ae9b1b-734c-448b-8981-d141cdd2dfce","Type":"ContainerStarted","Data":"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"}
Sep 10 22:31:04.278545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.278431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" event={"ID":"20ae9b1b-734c-448b-8981-d141cdd2dfce","Type":"ContainerStarted","Data":"e1c8064be56047091c817ebb16c24a050a2a669cad442ce9e70a7a9f2392470c"}
Sep 10 22:31:04.278545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.278532    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:04.296852 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.296801    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" podStartSLOduration=1.296783038 podStartE2EDuration="1.296783038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:04.294747743 +0000 UTC m=+770.878824786" watchObservedRunningTime="2026-09-10 22:31:04.296783038 +0000 UTC m=+770.880860078"
Sep 10 22:31:04.861092 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:04.861050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:31:05.284372 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:05.284338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" event={"ID":"7d23263b-c401-41db-b9fa-1161b3693cd8","Type":"ContainerStarted","Data":"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"}
Sep 10 22:31:05.284598 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:05.284577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:05.303881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:05.303830    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" podStartSLOduration=2.303813751 podStartE2EDuration="2.303813751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:05.301550298 +0000 UTC m=+771.885627338" watchObservedRunningTime="2026-09-10 22:31:05.303813751 +0000 UTC m=+771.887890799"
Sep 10 22:31:15.286502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:15.286466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:16.292400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:16.292367    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:22.544479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.544442    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:31:22.551673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.551652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.554201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.554175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-481dd50d-kserve-self-signed-certs\""
Sep 10 22:31:22.555363 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.555342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:31:22.564523 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.564499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:22.743511 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.743663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.743663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.743663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.743663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.743663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.743628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4r6v\" (UniqueName: \"kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.844990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.844911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.844990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.844951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.844990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.844977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4r6v\" (UniqueName: \"kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845226 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845226 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845226 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845371 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845371 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.845485 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.845462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.847220 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.847196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.847642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.847615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.853528 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.853473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4r6v\" (UniqueName: \"kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v\") pod \"e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") " pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:22.861421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:22.861399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:23.130181 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:23.130111    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:31:23.132546 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:23.132517    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod489b91a5_7a88_476d_b81a_ced6191d91c6.slice/crio-8a497635ff9740e4a69677a5dd1a103b74885d4a963f5182dfd0e27c75afd767 WatchSource:0}: Error finding container 8a497635ff9740e4a69677a5dd1a103b74885d4a963f5182dfd0e27c75afd767: Status 404 returned error can't find the container with id 8a497635ff9740e4a69677a5dd1a103b74885d4a963f5182dfd0e27c75afd767
Sep 10 22:31:23.370403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:23.370366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" event={"ID":"489b91a5-7a88-476d-b81a-ced6191d91c6","Type":"ContainerStarted","Data":"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"}
Sep 10 22:31:23.370403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:23.370405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" event={"ID":"489b91a5-7a88-476d-b81a-ced6191d91c6","Type":"ContainerStarted","Data":"8a497635ff9740e4a69677a5dd1a103b74885d4a963f5182dfd0e27c75afd767"}
Sep 10 22:31:23.386405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:23.386304    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" podStartSLOduration=1.3862880450000001 podStartE2EDuration="1.386288045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:23.385789267 +0000 UTC m=+789.969866311" watchObservedRunningTime="2026-09-10 22:31:23.386288045 +0000 UTC m=+789.970365085"
Sep 10 22:31:24.341884 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:24.341850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:31:27.474695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.474660    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"]
Sep 10 22:31:27.478409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.478388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:27.480900 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.480877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:31:27.480994 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.480970    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:31:27.482462 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.482437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr\" (UID: \"0dec5fe8-75ea-41b4-9f9b-da6f233e6905\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:27.486507 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.486474    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"]
Sep 10 22:31:27.583788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.583762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr\" (UID: \"0dec5fe8-75ea-41b4-9f9b-da6f233e6905\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:27.584334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.584316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr\" (UID: \"0dec5fe8-75ea-41b4-9f9b-da6f233e6905\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:27.789953 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:27.789890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:28.057203 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:28.057179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"]
Sep 10 22:31:28.058890 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:28.058863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dec5fe8_75ea_41b4_9f9b_da6f233e6905.slice/crio-b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21 WatchSource:0}: Error finding container b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21: Status 404 returned error can't find the container with id b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21
Sep 10 22:31:28.393920 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:28.393859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr" event={"ID":"0dec5fe8-75ea-41b4-9f9b-da6f233e6905","Type":"ContainerStarted","Data":"2a3f116ee79bdf97eae714dbea4291d6f8a0e41079a49b770934b9b187cc5445"}
Sep 10 22:31:28.393920 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:28.393903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr" event={"ID":"0dec5fe8-75ea-41b4-9f9b-da6f233e6905","Type":"ContainerStarted","Data":"b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21"}
Sep 10 22:31:28.407677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:28.407631    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr" podStartSLOduration=1.407617074 podStartE2EDuration="1.407617074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:28.406880668 +0000 UTC m=+794.990957709" watchObservedRunningTime="2026-09-10 22:31:28.407617074 +0000 UTC m=+794.991694114"
Sep 10 22:31:28.986465 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:28.986432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:29.400944 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:29.400848    2559 generic.go:356] "Generic (PLEG): container finished" podID="0dec5fe8-75ea-41b4-9f9b-da6f233e6905" containerID="2a3f116ee79bdf97eae714dbea4291d6f8a0e41079a49b770934b9b187cc5445" exitCode=0
Sep 10 22:31:29.401094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:29.400933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr" event={"ID":"0dec5fe8-75ea-41b4-9f9b-da6f233e6905","Type":"ContainerDied","Data":"2a3f116ee79bdf97eae714dbea4291d6f8a0e41079a49b770934b9b187cc5445"}
Sep 10 22:31:30.532844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:30.532822    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:30.607333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:30.607309    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca\") pod \"0dec5fe8-75ea-41b4-9f9b-da6f233e6905\" (UID: \"0dec5fe8-75ea-41b4-9f9b-da6f233e6905\") "
Sep 10 22:31:30.607674 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:30.607651    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0dec5fe8-75ea-41b4-9f9b-da6f233e6905" (UID: "0dec5fe8-75ea-41b4-9f9b-da6f233e6905"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:30.708749 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:30.708727    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dec5fe8-75ea-41b4-9f9b-da6f233e6905-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:31:31.413215 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:31.413184    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"
Sep 10 22:31:31.413421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:31.413183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr" event={"ID":"0dec5fe8-75ea-41b4-9f9b-da6f233e6905","Type":"ContainerDied","Data":"b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21"}
Sep 10 22:31:31.413421 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:31.413303    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8843c60534656f6a326157f7fd646ee58eda3ade9d1da1fb6b3baae49df4d21"
Sep 10 22:31:32.862407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:32.862370    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:32.862885 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:32.862428    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:32.875607 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:32.875578    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:33.433327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.433301    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:31:33.569840 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.569808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:33.596919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.596888    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:33.597139 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.597112    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" podUID="7d23263b-c401-41db-b9fa-1161b3693cd8" containerName="payload-processing" containerID="cri-o://067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3" gracePeriod=30
Sep 10 22:31:33.605731 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.605708    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:33.605909 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.605876    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" podUID="20ae9b1b-734c-448b-8981-d141cdd2dfce" containerName="payload-pre-processing" containerID="cri-o://01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1" gracePeriod=30
Sep 10 22:31:33.636688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.636661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:33.740124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.740081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:33.771879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.770925    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"]
Sep 10 22:31:33.774195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.774164    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2643d53e-qxfpr"]
Sep 10 22:31:33.827128 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.826950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:33.891461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.891426    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:33.893180 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.893155    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dec5fe8-75ea-41b4-9f9b-da6f233e6905" path="/var/lib/kubelet/pods/0dec5fe8-75ea-41b4-9f9b-da6f233e6905/volumes"
Sep 10 22:31:33.893979 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.893961    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:33.916238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.916199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:33.935477 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.935445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhg2t\" (UniqueName: \"kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t\") pod \"20ae9b1b-734c-448b-8981-d141cdd2dfce\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") "
Sep 10 22:31:33.935649 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.935628    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn2r6\" (UniqueName: \"kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6\") pod \"7d23263b-c401-41db-b9fa-1161b3693cd8\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") "
Sep 10 22:31:33.935727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.935687    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume\") pod \"20ae9b1b-734c-448b-8981-d141cdd2dfce\" (UID: \"20ae9b1b-734c-448b-8981-d141cdd2dfce\") "
Sep 10 22:31:33.935787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.935728    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume\") pod \"7d23263b-c401-41db-b9fa-1161b3693cd8\" (UID: \"7d23263b-c401-41db-b9fa-1161b3693cd8\") "
Sep 10 22:31:33.936091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.936059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20ae9b1b-734c-448b-8981-d141cdd2dfce" (UID: "20ae9b1b-734c-448b-8981-d141cdd2dfce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:33.936207 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.936140    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d23263b-c401-41db-b9fa-1161b3693cd8" (UID: "7d23263b-c401-41db-b9fa-1161b3693cd8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:33.937727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.937702    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t" (OuterVolumeSpecName: "kube-api-access-nhg2t") pod "20ae9b1b-734c-448b-8981-d141cdd2dfce" (UID: "20ae9b1b-734c-448b-8981-d141cdd2dfce"). InnerVolumeSpecName "kube-api-access-nhg2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:33.937966 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:33.937942    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6" (OuterVolumeSpecName: "kube-api-access-gn2r6") pod "7d23263b-c401-41db-b9fa-1161b3693cd8" (UID: "7d23263b-c401-41db-b9fa-1161b3693cd8"). InnerVolumeSpecName "kube-api-access-gn2r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:34.036751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.036656    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn2r6\" (UniqueName: \"kubernetes.io/projected/7d23263b-c401-41db-b9fa-1161b3693cd8-kube-api-access-gn2r6\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.036751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.036691    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20ae9b1b-734c-448b-8981-d141cdd2dfce-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.036751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.036704    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d23263b-c401-41db-b9fa-1161b3693cd8-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.036751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.036717    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhg2t\" (UniqueName: \"kubernetes.io/projected/20ae9b1b-734c-448b-8981-d141cdd2dfce-kube-api-access-nhg2t\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.347036 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.346956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:34.428057 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.428027    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ae9b1b-734c-448b-8981-d141cdd2dfce" containerID="01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1" exitCode=0
Sep 10 22:31:34.428233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.428075    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"
Sep 10 22:31:34.428233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.428116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" event={"ID":"20ae9b1b-734c-448b-8981-d141cdd2dfce","Type":"ContainerDied","Data":"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"}
Sep 10 22:31:34.428233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.428166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8" event={"ID":"20ae9b1b-734c-448b-8981-d141cdd2dfce","Type":"ContainerDied","Data":"e1c8064be56047091c817ebb16c24a050a2a669cad442ce9e70a7a9f2392470c"}
Sep 10 22:31:34.428233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.428188    2559 scope.go:117] "RemoveContainer" containerID="01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"
Sep 10 22:31:34.429461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.429439    2559 generic.go:356] "Generic (PLEG): container finished" podID="7d23263b-c401-41db-b9fa-1161b3693cd8" containerID="067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3" exitCode=0
Sep 10 22:31:34.429603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.429468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" event={"ID":"7d23263b-c401-41db-b9fa-1161b3693cd8","Type":"ContainerDied","Data":"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"}
Sep 10 22:31:34.429603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.429514    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"
Sep 10 22:31:34.429603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.429541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq" event={"ID":"7d23263b-c401-41db-b9fa-1161b3693cd8","Type":"ContainerDied","Data":"58b3a263134ca3255b9b86541f3be2561d04c750e4f044a9fadf28547a614285"}
Sep 10 22:31:34.438712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.438693    2559 scope.go:117] "RemoveContainer" containerID="01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"
Sep 10 22:31:34.439074 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:31:34.439053    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1\": container with ID starting with 01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1 not found: ID does not exist" containerID="01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"
Sep 10 22:31:34.439143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.439082    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1"} err="failed to get container status \"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1\": rpc error: code = NotFound desc = could not find container \"01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1\": container with ID starting with 01876a309f4becbda230ee6dbdfce72f42f6311e95f369f135418e412c698af1 not found: ID does not exist"
Sep 10 22:31:34.439143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.439099    2559 scope.go:117] "RemoveContainer" containerID="067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"
Sep 10 22:31:34.446864 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.446847    2559 scope.go:117] "RemoveContainer" containerID="067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"
Sep 10 22:31:34.447133 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:31:34.447111    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3\": container with ID starting with 067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3 not found: ID does not exist" containerID="067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"
Sep 10 22:31:34.447182 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.447140    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3"} err="failed to get container status \"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3\": rpc error: code = NotFound desc = could not find container \"067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3\": container with ID starting with 067cdcf3b544cc8d70d3dcb53fc9e8343f26e4e4211862f4f646afb928cd0db3 not found: ID does not exist"
Sep 10 22:31:34.449974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.449949    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:34.457014 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.456990    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8"]
Sep 10 22:31:34.466167 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.466142    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:34.470935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.470914    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq"]
Sep 10 22:31:34.665280 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.665192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:34.788303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:34.788271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:35.892129 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:35.892087    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ae9b1b-734c-448b-8981-d141cdd2dfce" path="/var/lib/kubelet/pods/20ae9b1b-734c-448b-8981-d141cdd2dfce/volumes"
Sep 10 22:31:35.892667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:35.892649    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d23263b-c401-41db-b9fa-1161b3693cd8" path="/var/lib/kubelet/pods/7d23263b-c401-41db-b9fa-1161b3693cd8/volumes"
Sep 10 22:31:37.109879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:37.109841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:37.197176 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:37.197129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.316698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.316654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.419306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.419271    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.553644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.553608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.834264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.834233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.938840 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.938809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:31:38.946234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946203    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:31:38.946574 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946561    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d23263b-c401-41db-b9fa-1161b3693cd8" containerName="payload-processing"
Sep 10 22:31:38.946658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946576    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d23263b-c401-41db-b9fa-1161b3693cd8" containerName="payload-processing"
Sep 10 22:31:38.946658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946592    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ae9b1b-734c-448b-8981-d141cdd2dfce" containerName="payload-pre-processing"
Sep 10 22:31:38.946658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946598    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ae9b1b-734c-448b-8981-d141cdd2dfce" containerName="payload-pre-processing"
Sep 10 22:31:38.946658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946611    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dec5fe8-75ea-41b4-9f9b-da6f233e6905" containerName="revoke-keys"
Sep 10 22:31:38.946658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946617    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dec5fe8-75ea-41b4-9f9b-da6f233e6905" containerName="revoke-keys"
Sep 10 22:31:38.946821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946693    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ae9b1b-734c-448b-8981-d141cdd2dfce" containerName="payload-pre-processing"
Sep 10 22:31:38.946821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946706    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dec5fe8-75ea-41b4-9f9b-da6f233e6905" containerName="revoke-keys"
Sep 10 22:31:38.946821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.946718    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d23263b-c401-41db-b9fa-1161b3693cd8" containerName="payload-processing"
Sep 10 22:31:38.950894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.950875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:38.953123 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.953102    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-df975900\""
Sep 10 22:31:38.961768 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.961745    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:31:38.978394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.978365    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:31:38.981603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.981588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:38.981927 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.981908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:38.982026 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.982008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtnr\" (UniqueName: \"kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:38.984310 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.984294    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-df975900-dockercfg-chsft\""
Sep 10 22:31:38.991688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:38.991665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:31:39.083137 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.083104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:39.083308 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.083176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtnr\" (UniqueName: \"kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:39.083308 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.083210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtmb\" (UniqueName: \"kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.083308 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.083240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.083856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.083838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:39.094753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.094691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtnr\" (UniqueName: \"kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr\") pod \"payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:39.184450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.184418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtmb\" (UniqueName: \"kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.184450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.184457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.185122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.185104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.192247 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.192224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtmb\" (UniqueName: \"kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb\") pod \"payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") " pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.261751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.261705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:39.292258 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.292225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:39.535175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.535149    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:31:39.536831 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:39.536806    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46835fd3_f693_4d3a_a1cc_8917b55ac162.slice/crio-718105fd4f4c3ecb5e084fcc8ab5d05a11de6302705183dbb9921f98a0d6c4c1 WatchSource:0}: Error finding container 718105fd4f4c3ecb5e084fcc8ab5d05a11de6302705183dbb9921f98a0d6c4c1: Status 404 returned error can't find the container with id 718105fd4f4c3ecb5e084fcc8ab5d05a11de6302705183dbb9921f98a0d6c4c1
Sep 10 22:31:39.574561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:39.574531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:31:39.588699 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:31:39.588669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab1c6b4_fee9_497c_bc01_8629b14428a7.slice/crio-3fb4c06da621ff9b907f8e93c5f088e47d5012931801d1e9a110ddcc34947401 WatchSource:0}: Error finding container 3fb4c06da621ff9b907f8e93c5f088e47d5012931801d1e9a110ddcc34947401: Status 404 returned error can't find the container with id 3fb4c06da621ff9b907f8e93c5f088e47d5012931801d1e9a110ddcc34947401
Sep 10 22:31:40.463940 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.463904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" event={"ID":"9ab1c6b4-fee9-497c-bc01-8629b14428a7","Type":"ContainerStarted","Data":"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"}
Sep 10 22:31:40.464111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.463971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" event={"ID":"9ab1c6b4-fee9-497c-bc01-8629b14428a7","Type":"ContainerStarted","Data":"3fb4c06da621ff9b907f8e93c5f088e47d5012931801d1e9a110ddcc34947401"}
Sep 10 22:31:40.464111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.464017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:40.471077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.465864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" event={"ID":"46835fd3-f693-4d3a-a1cc-8917b55ac162","Type":"ContainerStarted","Data":"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"}
Sep 10 22:31:40.471077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.465964    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" event={"ID":"46835fd3-f693-4d3a-a1cc-8917b55ac162","Type":"ContainerStarted","Data":"718105fd4f4c3ecb5e084fcc8ab5d05a11de6302705183dbb9921f98a0d6c4c1"}
Sep 10 22:31:40.471077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.466656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:31:40.485796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.485751    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" podStartSLOduration=2.485736611 podStartE2EDuration="2.485736611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:40.48373373 +0000 UTC m=+807.067810771" watchObservedRunningTime="2026-09-10 22:31:40.485736611 +0000 UTC m=+807.069813651"
Sep 10 22:31:40.500096 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:40.500055    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" podStartSLOduration=2.5000412 podStartE2EDuration="2.5000412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:40.498948289 +0000 UTC m=+807.083025331" watchObservedRunningTime="2026-09-10 22:31:40.5000412 +0000 UTC m=+807.084118240"
Sep 10 22:31:47.446246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:47.446206    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:31:51.473159 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:51.473129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:31:52.478326 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:31:52.478292    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:32:01.892124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.892091    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"]
Sep 10 22:32:01.896952 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.896931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:01.899502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.899464    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:32:01.899932 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.899588    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:32:01.903472 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.903446    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"]
Sep 10 22:32:01.987865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:01.987821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-cc3245-xj2ms\" (UID: \"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:02.089311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.089264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-cc3245-xj2ms\" (UID: \"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:02.089963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.089939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-cc3245-xj2ms\" (UID: \"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:02.210376 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.210339    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:02.331151 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.331114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:02.484539 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.484433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"]
Sep 10 22:32:02.487738 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:02.487709    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030c03f5_f669_4c5c_8ef4_5154e3bd4bd0.slice/crio-961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183 WatchSource:0}: Error finding container 961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183: Status 404 returned error can't find the container with id 961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183
Sep 10 22:32:02.578245 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.578206    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms" event={"ID":"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0","Type":"ContainerStarted","Data":"961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183"}
Sep 10 22:32:02.766302 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.766262    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"]
Sep 10 22:32:02.769863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.769835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:02.777095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.777065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"]
Sep 10 22:32:02.898054 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.898009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df975900-dlk72\" (UID: \"a5fdad44-5510-4f75-8c43-0cfe24bd4d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:02.999314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.999276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df975900-dlk72\" (UID: \"a5fdad44-5510-4f75-8c43-0cfe24bd4d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:02.999979 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:02.999957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df975900-dlk72\" (UID: \"a5fdad44-5510-4f75-8c43-0cfe24bd4d28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:03.082166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.082056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:03.130384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.130342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:03.357286 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.357253    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"]
Sep 10 22:32:03.359260 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:03.359229    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fdad44_5510_4f75_8c43_0cfe24bd4d28.slice/crio-8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5 WatchSource:0}: Error finding container 8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5: Status 404 returned error can't find the container with id 8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5
Sep 10 22:32:03.584988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.584950    2559 generic.go:356] "Generic (PLEG): container finished" podID="030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" containerID="a502b08e4fd1db7436d28a6f459e792428f2a23a29d97642c3dbd966283061f2" exitCode=0
Sep 10 22:32:03.585197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.585032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms" event={"ID":"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0","Type":"ContainerDied","Data":"a502b08e4fd1db7436d28a6f459e792428f2a23a29d97642c3dbd966283061f2"}
Sep 10 22:32:03.586257 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:03.586232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72" event={"ID":"a5fdad44-5510-4f75-8c43-0cfe24bd4d28","Type":"ContainerStarted","Data":"8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5"}
Sep 10 22:32:04.544879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.544841    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:32:04.592410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.592375    2559 generic.go:356] "Generic (PLEG): container finished" podID="a5fdad44-5510-4f75-8c43-0cfe24bd4d28" containerID="4073069c7f9366bea66495fb556df32e07cfa9b59b34a46899b9c4fa8602d716" exitCode=0
Sep 10 22:32:04.592630 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.592461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72" event={"ID":"a5fdad44-5510-4f75-8c43-0cfe24bd4d28","Type":"ContainerDied","Data":"4073069c7f9366bea66495fb556df32e07cfa9b59b34a46899b9c4fa8602d716"}
Sep 10 22:32:04.734362 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.734331    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:04.816398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.816296    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca\") pod \"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0\" (UID: \"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0\") "
Sep 10 22:32:04.816691 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.816667    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" (UID: "030c03f5-f669-4c5c-8ef4-5154e3bd4bd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:04.917870 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:04.917831    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:05.599382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.599351    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"
Sep 10 22:32:05.599808 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.599392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms" event={"ID":"030c03f5-f669-4c5c-8ef4-5154e3bd4bd0","Type":"ContainerDied","Data":"961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183"}
Sep 10 22:32:05.599808 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.599437    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="961109d88cdcfd3659df2875981984440be3deac7f99d55eec1a96bc31653183"
Sep 10 22:32:05.736585 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.736549    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:05.826386 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.826346    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca\") pod \"a5fdad44-5510-4f75-8c43-0cfe24bd4d28\" (UID: \"a5fdad44-5510-4f75-8c43-0cfe24bd4d28\") "
Sep 10 22:32:05.826758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.826734    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5fdad44-5510-4f75-8c43-0cfe24bd4d28" (UID: "a5fdad44-5510-4f75-8c43-0cfe24bd4d28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:05.933102 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:05.928854    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fdad44-5510-4f75-8c43-0cfe24bd4d28-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:06.605982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:06.605950    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"
Sep 10 22:32:06.606386 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:06.605985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72" event={"ID":"a5fdad44-5510-4f75-8c43-0cfe24bd4d28","Type":"ContainerDied","Data":"8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5"}
Sep 10 22:32:06.606386 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:06.606060    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ce092f2aeb14c0c34888777b41b6d0bd5f9e1d699a504401b160bfc50424ea5"
Sep 10 22:32:07.556030 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.555990    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:32:07.556346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556335    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fdad44-5510-4f75-8c43-0cfe24bd4d28" containerName="revoke-keys"
Sep 10 22:32:07.556391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556348    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fdad44-5510-4f75-8c43-0cfe24bd4d28" containerName="revoke-keys"
Sep 10 22:32:07.556391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556375    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" containerName="revoke-keys"
Sep 10 22:32:07.556391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556380    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" containerName="revoke-keys"
Sep 10 22:32:07.556510 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556437    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fdad44-5510-4f75-8c43-0cfe24bd4d28" containerName="revoke-keys"
Sep 10 22:32:07.556510 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.556448    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" containerName="revoke-keys"
Sep 10 22:32:07.559570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.559551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.562329 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.562302    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ddf324\"/\"kube-root-ca.crt\""
Sep 10 22:32:07.563675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.563659    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ddf324\"/\"openshift-service-ca.crt\""
Sep 10 22:32:07.564661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.564636    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ddf324\"/\"test-model-ddf324-kserve-self-signed-certs\""
Sep 10 22:32:07.564795 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.564641    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ddf324\"/\"default-dockercfg-m266z\""
Sep 10 22:32:07.574385 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.574351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:32:07.588330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.588292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:07.743723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.743723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf8sj\" (UniqueName: \"kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.744173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.744173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.744173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.744173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.743931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845237 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845237 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf8sj\" (UniqueName: \"kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845762 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.845816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.845748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.847739 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.847713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.847961 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.847943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.853872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.853843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf8sj\" (UniqueName: \"kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj\") pod \"test-model-ddf324-kserve-5857ffcfbc-f6h8x\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") " pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:07.869844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:07.869805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:08.144765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.144730    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:32:08.146747 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:08.146717    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc27e3b42_afc3_4e73_b0d6_2ef56b096fd5.slice/crio-43d1b57bc473bd9d673fada1b20b352c62ba4322826248f17e65606e17fc4cd6 WatchSource:0}: Error finding container 43d1b57bc473bd9d673fada1b20b352c62ba4322826248f17e65606e17fc4cd6: Status 404 returned error can't find the container with id 43d1b57bc473bd9d673fada1b20b352c62ba4322826248f17e65606e17fc4cd6
Sep 10 22:32:08.618264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.618225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" event={"ID":"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5","Type":"ContainerStarted","Data":"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"}
Sep 10 22:32:08.618264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.618273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" event={"ID":"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5","Type":"ContainerStarted","Data":"43d1b57bc473bd9d673fada1b20b352c62ba4322826248f17e65606e17fc4cd6"}
Sep 10 22:32:08.636263 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.636206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" podStartSLOduration=1.6361893570000001 podStartE2EDuration="1.636189357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:08.634166979 +0000 UTC m=+835.218244024" watchObservedRunningTime="2026-09-10 22:32:08.636189357 +0000 UTC m=+835.220266397"
Sep 10 22:32:08.890756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.890654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:08.924904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.924871    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:32:08.925139 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.925115    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" podUID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" containerName="payload-processing" containerID="cri-o://3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41" gracePeriod=30
Sep 10 22:32:08.930636 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.930418    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:32:08.930844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.930814    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" podUID="46835fd3-f693-4d3a-a1cc-8917b55ac162" containerName="payload-pre-processing" containerID="cri-o://040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca" gracePeriod=30
Sep 10 22:32:08.957054 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:08.957012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:09.057291 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.057251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:09.102964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.102930    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"]
Sep 10 22:32:09.109697 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.109662    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df975900-dlk72"]
Sep 10 22:32:09.130706 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.130591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:09.213838 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.213811    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:32:09.216583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.216558    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:32:09.358136 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358096    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume\") pod \"46835fd3-f693-4d3a-a1cc-8917b55ac162\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") "
Sep 10 22:32:09.358136 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtnr\" (UniqueName: \"kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr\") pod \"46835fd3-f693-4d3a-a1cc-8917b55ac162\" (UID: \"46835fd3-f693-4d3a-a1cc-8917b55ac162\") "
Sep 10 22:32:09.358398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358230    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume\") pod \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") "
Sep 10 22:32:09.358398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358266    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwtmb\" (UniqueName: \"kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb\") pod \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\" (UID: \"9ab1c6b4-fee9-497c-bc01-8629b14428a7\") "
Sep 10 22:32:09.358632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358601    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46835fd3-f693-4d3a-a1cc-8917b55ac162" (UID: "46835fd3-f693-4d3a-a1cc-8917b55ac162"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:09.358756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.358684    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ab1c6b4-fee9-497c-bc01-8629b14428a7" (UID: "9ab1c6b4-fee9-497c-bc01-8629b14428a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:09.360505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.360466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb" (OuterVolumeSpecName: "kube-api-access-bwtmb") pod "9ab1c6b4-fee9-497c-bc01-8629b14428a7" (UID: "9ab1c6b4-fee9-497c-bc01-8629b14428a7"). InnerVolumeSpecName "kube-api-access-bwtmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:09.360594 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.360505    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr" (OuterVolumeSpecName: "kube-api-access-6rtnr") pod "46835fd3-f693-4d3a-a1cc-8917b55ac162" (UID: "46835fd3-f693-4d3a-a1cc-8917b55ac162"). InnerVolumeSpecName "kube-api-access-6rtnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:09.459893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.459854    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ab1c6b4-fee9-497c-bc01-8629b14428a7-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.459893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.459888    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwtmb\" (UniqueName: \"kubernetes.io/projected/9ab1c6b4-fee9-497c-bc01-8629b14428a7-kube-api-access-bwtmb\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.459893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.459897    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46835fd3-f693-4d3a-a1cc-8917b55ac162-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.460191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.459907    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtnr\" (UniqueName: \"kubernetes.io/projected/46835fd3-f693-4d3a-a1cc-8917b55ac162-kube-api-access-6rtnr\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.625892 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.625850    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" containerID="3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41" exitCode=0
Sep 10 22:32:09.626072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.625898    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"
Sep 10 22:32:09.626072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.625941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" event={"ID":"9ab1c6b4-fee9-497c-bc01-8629b14428a7","Type":"ContainerDied","Data":"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"}
Sep 10 22:32:09.626072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.625989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8" event={"ID":"9ab1c6b4-fee9-497c-bc01-8629b14428a7","Type":"ContainerDied","Data":"3fb4c06da621ff9b907f8e93c5f088e47d5012931801d1e9a110ddcc34947401"}
Sep 10 22:32:09.626072 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.626015    2559 scope.go:117] "RemoveContainer" containerID="3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"
Sep 10 22:32:09.627315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.627291    2559 generic.go:356] "Generic (PLEG): container finished" podID="46835fd3-f693-4d3a-a1cc-8917b55ac162" containerID="040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca" exitCode=0
Sep 10 22:32:09.627387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.627334    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"
Sep 10 22:32:09.627450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.627376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" event={"ID":"46835fd3-f693-4d3a-a1cc-8917b55ac162","Type":"ContainerDied","Data":"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"}
Sep 10 22:32:09.627450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.627424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f" event={"ID":"46835fd3-f693-4d3a-a1cc-8917b55ac162","Type":"ContainerDied","Data":"718105fd4f4c3ecb5e084fcc8ab5d05a11de6302705183dbb9921f98a0d6c4c1"}
Sep 10 22:32:09.636555 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.636530    2559 scope.go:117] "RemoveContainer" containerID="3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"
Sep 10 22:32:09.636941 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:09.636918    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41\": container with ID starting with 3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41 not found: ID does not exist" containerID="3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"
Sep 10 22:32:09.637076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.636948    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41"} err="failed to get container status \"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41\": rpc error: code = NotFound desc = could not find container \"3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41\": container with ID starting with 3c68f6529a2e4362f8dd92b718c9ea7155d7ef12361f081b8ff428aa1f249a41 not found: ID does not exist"
Sep 10 22:32:09.637076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.636974    2559 scope.go:117] "RemoveContainer" containerID="040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"
Sep 10 22:32:09.655062 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.655013    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:32:09.655459 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.655429    2559 scope.go:117] "RemoveContainer" containerID="040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"
Sep 10 22:32:09.655812 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:09.655788    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca\": container with ID starting with 040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca not found: ID does not exist" containerID="040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"
Sep 10 22:32:09.655919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.655818    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca"} err="failed to get container status \"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca\": rpc error: code = NotFound desc = could not find container \"040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca\": container with ID starting with 040a9b084ee907676b33b5a250b5be47ffec0bc9d393ca6da869bcf7532b8cca not found: ID does not exist"
Sep 10 22:32:09.658957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.658930    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f"]
Sep 10 22:32:09.673266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.673222    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:32:09.676707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.676666    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8"]
Sep 10 22:32:09.892163 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.892123    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46835fd3-f693-4d3a-a1cc-8917b55ac162" path="/var/lib/kubelet/pods/46835fd3-f693-4d3a-a1cc-8917b55ac162/volumes"
Sep 10 22:32:09.892553 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.892538    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" path="/var/lib/kubelet/pods/9ab1c6b4-fee9-497c-bc01-8629b14428a7/volumes"
Sep 10 22:32:09.892838 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:09.892826    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5fdad44-5510-4f75-8c43-0cfe24bd4d28" path="/var/lib/kubelet/pods/a5fdad44-5510-4f75-8c43-0cfe24bd4d28/volumes"
Sep 10 22:32:10.174553 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:10.174429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:10.326073 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:10.326037    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:32:10.347677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:10.347645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:10.616274 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:10.616232    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:10.890262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:10.890164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:11.182776 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:11.182690    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:12.026379 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.026339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:12.635251 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.635199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:12.669730 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.669600    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:32:12.669925 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.669861    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" podUID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" containerName="payload-processing" containerID="cri-o://afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034" gracePeriod=30
Sep 10 22:32:12.735201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.735167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:12.835702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.835670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:12.851043 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.851007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"]
Sep 10 22:32:12.852758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.852736    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-cc3245-xj2ms"]
Sep 10 22:32:12.919657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.919624    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:32:12.948399 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:12.948336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:13.039121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.039090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:13.092963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.092917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume\") pod \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") "
Sep 10 22:32:13.093171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.093064    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7gns\" (UniqueName: \"kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns\") pod \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\" (UID: \"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb\") "
Sep 10 22:32:13.093355 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.093328    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" (UID: "5ece9d2c-16cb-48b3-ae4f-ab85caf966eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:13.095121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.095094    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns" (OuterVolumeSpecName: "kube-api-access-j7gns") pod "5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" (UID: "5ece9d2c-16cb-48b3-ae4f-ab85caf966eb"). InnerVolumeSpecName "kube-api-access-j7gns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:13.190839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.190752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:13.194646 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.194623    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7gns\" (UniqueName: \"kubernetes.io/projected/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-kube-api-access-j7gns\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.194725 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.194648    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.650477 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.650440    2559 generic.go:356] "Generic (PLEG): container finished" podID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" containerID="afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034" exitCode=0
Sep 10 22:32:13.650951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.650565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"
Sep 10 22:32:13.650951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.650602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" event={"ID":"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb","Type":"ContainerDied","Data":"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"}
Sep 10 22:32:13.650951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.650673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx" event={"ID":"5ece9d2c-16cb-48b3-ae4f-ab85caf966eb","Type":"ContainerDied","Data":"2f2f3aa9cc20845c205919f2eecc5363943e7df5f3105f04fdb2eb2c013cd38b"}
Sep 10 22:32:13.650951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.650709    2559 scope.go:117] "RemoveContainer" containerID="afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"
Sep 10 22:32:13.660317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.660292    2559 scope.go:117] "RemoveContainer" containerID="afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"
Sep 10 22:32:13.660670 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:13.660651    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034\": container with ID starting with afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034 not found: ID does not exist" containerID="afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"
Sep 10 22:32:13.660729 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.660681    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034"} err="failed to get container status \"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034\": rpc error: code = NotFound desc = could not find container \"afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034\": container with ID starting with afb36ea594ab2321864e3ab6e3ab3342a898ff358d12ed5cb439508b5743e034 not found: ID does not exist"
Sep 10 22:32:13.672197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.672162    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:32:13.677616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.677587    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx"]
Sep 10 22:32:13.897583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.897548    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="030c03f5-f669-4c5c-8ef4-5154e3bd4bd0" path="/var/lib/kubelet/pods/030c03f5-f669-4c5c-8ef4-5154e3bd4bd0/volumes"
Sep 10 22:32:13.897944 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:13.897931    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" path="/var/lib/kubelet/pods/5ece9d2c-16cb-48b3-ae4f-ab85caf966eb/volumes"
Sep 10 22:32:14.214026 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.213984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.316826 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.316752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.325414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.325378    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:32:14.383045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.383013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.483141 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.483043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.694015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.693975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.775546 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.775445    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:14.812901 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.812867    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:14.813193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813181    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" containerName="payload-processing"
Sep 10 22:32:14.813234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813196    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" containerName="payload-processing"
Sep 10 22:32:14.813234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813207    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" containerName="payload-processing"
Sep 10 22:32:14.813234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813213    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" containerName="payload-processing"
Sep 10 22:32:14.813234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813230    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46835fd3-f693-4d3a-a1cc-8917b55ac162" containerName="payload-pre-processing"
Sep 10 22:32:14.813350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813236    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46835fd3-f693-4d3a-a1cc-8917b55ac162" containerName="payload-pre-processing"
Sep 10 22:32:14.813350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813294    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46835fd3-f693-4d3a-a1cc-8917b55ac162" containerName="payload-pre-processing"
Sep 10 22:32:14.813350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813302    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ece9d2c-16cb-48b3-ae4f-ab85caf966eb" containerName="payload-processing"
Sep 10 22:32:14.813350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.813310    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab1c6b4-fee9-497c-bc01-8629b14428a7" containerName="payload-processing"
Sep 10 22:32:14.818083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.818062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:14.820529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.820507    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-e01e31eb\""
Sep 10 22:32:14.828610 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.828580    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:14.839103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.839063    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:14.842983 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.842952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:14.845250 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.845229    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-e01e31eb-dockercfg-szdnl\""
Sep 10 22:32:14.853022 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:14.852990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:15.011417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.011374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kds5s\" (UniqueName: \"kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.011643 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.011433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9kw\" (UniqueName: \"kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.011643 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.011463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.011643 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.011505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.112765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.112664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kds5s\" (UniqueName: \"kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.112765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.112732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9kw\" (UniqueName: \"kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.112993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.112779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.112993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.112808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.113648 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.113621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.113741 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.113627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.121676 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.121648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9kw\" (UniqueName: \"kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw\") pod \"payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.121815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.121649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kds5s\" (UniqueName: \"kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s\") pod \"payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") " pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.129461 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.129429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.154823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.154791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.401291 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.401260    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:15.403259 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:15.403230    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2fb7a9_c665_4c65_ba5d_a359ad34e797.slice/crio-f9b5dd316e5e25813e28428193c22ef94bd60ea384088d857b1c73705f4c34a1 WatchSource:0}: Error finding container f9b5dd316e5e25813e28428193c22ef94bd60ea384088d857b1c73705f4c34a1: Status 404 returned error can't find the container with id f9b5dd316e5e25813e28428193c22ef94bd60ea384088d857b1c73705f4c34a1
Sep 10 22:32:15.450510 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.450393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:15.452954 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:15.452927    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a5c280_0203_4da3_a545_f90e473c5043.slice/crio-4c259e47aa18e7b005e9c088ef33608c53f844f9b70b9f87015b6b1d713aa056 WatchSource:0}: Error finding container 4c259e47aa18e7b005e9c088ef33608c53f844f9b70b9f87015b6b1d713aa056: Status 404 returned error can't find the container with id 4c259e47aa18e7b005e9c088ef33608c53f844f9b70b9f87015b6b1d713aa056
Sep 10 22:32:15.663719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.663617    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" event={"ID":"83a5c280-0203-4da3-a545-f90e473c5043","Type":"ContainerStarted","Data":"f51a0ff34776791d9c96059e17cc39119de7e1afa2d847784ccfe3cde859edf5"}
Sep 10 22:32:15.663719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.663681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" event={"ID":"83a5c280-0203-4da3-a545-f90e473c5043","Type":"ContainerStarted","Data":"4c259e47aa18e7b005e9c088ef33608c53f844f9b70b9f87015b6b1d713aa056"}
Sep 10 22:32:15.663719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.663712    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:15.665268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.665237    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" event={"ID":"9d2fb7a9-c665-4c65-ba5d-a359ad34e797","Type":"ContainerStarted","Data":"f2d36b50c753c499f6e163ecec855bae71a9f3a01a1b4300e79bb737aeeaa2c2"}
Sep 10 22:32:15.665440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.665286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" event={"ID":"9d2fb7a9-c665-4c65-ba5d-a359ad34e797","Type":"ContainerStarted","Data":"f9b5dd316e5e25813e28428193c22ef94bd60ea384088d857b1c73705f4c34a1"}
Sep 10 22:32:15.665440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.665313    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:15.698349 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.698267    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" podStartSLOduration=1.698242582 podStartE2EDuration="1.698242582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:15.695853431 +0000 UTC m=+842.279930476" watchObservedRunningTime="2026-09-10 22:32:15.698242582 +0000 UTC m=+842.282319622"
Sep 10 22:32:15.698746 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:15.698409    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" podStartSLOduration=1.698398378 podStartE2EDuration="1.698398378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:15.679252134 +0000 UTC m=+842.263329176" watchObservedRunningTime="2026-09-10 22:32:15.698398378 +0000 UTC m=+842.282475419"
Sep 10 22:32:16.511331 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:16.511301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:17.870694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:17.870649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:17.871122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:17.870729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:17.884276 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:17.884246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:18.267254 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:18.267221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:18.693355 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:18.693266    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:32:19.539977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:19.539940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:25.346168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.346118    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" podUID="5a5602b9-e43f-4248-9dce-3dd478e78151" containerName="main" containerID="cri-o://f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc" gracePeriod=45
Sep 10 22:32:25.603967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.603888    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:32:25.701315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701272    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701340    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jrm9\" (UniqueName: \"kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9\") pod \"5a5602b9-e43f-4248-9dce-3dd478e78151\" (UID: \"5a5602b9-e43f-4248-9dce-3dd478e78151\") "
Sep 10 22:32:25.701753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701708    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home" (OuterVolumeSpecName: "home") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:25.701828 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701747    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:25.701828 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701810    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:25.701902 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701878    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.701942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.701898    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.703623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.703600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm" (OuterVolumeSpecName: "dshm") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:25.703702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.703680    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:25.703789 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.703763    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9" (OuterVolumeSpecName: "kube-api-access-9jrm9") pod "5a5602b9-e43f-4248-9dce-3dd478e78151" (UID: "5a5602b9-e43f-4248-9dce-3dd478e78151"). InnerVolumeSpecName "kube-api-access-9jrm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:25.722799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.722754    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a5602b9-e43f-4248-9dce-3dd478e78151" containerID="f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc" exitCode=0
Sep 10 22:32:25.722799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.722792    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"
Sep 10 22:32:25.723044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.722789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" event={"ID":"5a5602b9-e43f-4248-9dce-3dd478e78151","Type":"ContainerDied","Data":"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"}
Sep 10 22:32:25.723044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.722895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8" event={"ID":"5a5602b9-e43f-4248-9dce-3dd478e78151","Type":"ContainerDied","Data":"54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736"}
Sep 10 22:32:25.723044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.722918    2559 scope.go:117] "RemoveContainer" containerID="f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"
Sep 10 22:32:25.732829 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.732807    2559 scope.go:117] "RemoveContainer" containerID="f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"
Sep 10 22:32:25.733137 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:25.733116    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc\": container with ID starting with f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc not found: ID does not exist" containerID="f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"
Sep 10 22:32:25.733204 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.733152    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc"} err="failed to get container status \"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc\": rpc error: code = NotFound desc = could not find container \"f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc\": container with ID starting with f4b5d691722893ea9b28999f14ed20cd23dac8bdd2b856b2583217bf1b87babc not found: ID does not exist"
Sep 10 22:32:25.745442 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.745403    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:32:25.750146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.750101    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-481dd50d-kserve-6f9b45f8c-sfpw8"]
Sep 10 22:32:25.753202 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:25.753173    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a5602b9_e43f_4248_9dce_3dd478e78151.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a5602b9_e43f_4248_9dce_3dd478e78151.slice/crio-54191cf0eec4f9861982c9b3d8c0a94d1164f1026088775fd5db6113cc504736\": RecentStats: unable to find data in memory cache]"
Sep 10 22:32:25.802814 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.802769    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jrm9\" (UniqueName: \"kubernetes.io/projected/5a5602b9-e43f-4248-9dce-3dd478e78151-kube-api-access-9jrm9\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.802814 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.802805    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5602b9-e43f-4248-9dce-3dd478e78151-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.802814 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.802818    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.803032 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.802827    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5602b9-e43f-4248-9dce-3dd478e78151-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:25.845471 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.845431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:32:25.891611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:25.891531    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5602b9-e43f-4248-9dce-3dd478e78151" path="/var/lib/kubelet/pods/5a5602b9-e43f-4248-9dce-3dd478e78151/volumes"
Sep 10 22:32:26.673125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:26.673094    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:26.673535 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:26.673293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:29.348269 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.348219    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" podUID="489b91a5-7a88-476d-b81a-ced6191d91c6" containerName="main" containerID="cri-o://196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97" gracePeriod=45
Sep 10 22:32:29.605957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.605874    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:32:29.640000 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.639966    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640020    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640050    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640093    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640121    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4r6v\" (UniqueName: \"kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640167    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir\") pod \"489b91a5-7a88-476d-b81a-ced6191d91c6\" (UID: \"489b91a5-7a88-476d-b81a-ced6191d91c6\") "
Sep 10 22:32:29.640510 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640310    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:29.640608 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640583    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.640733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640633    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:29.640733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.640651    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home" (OuterVolumeSpecName: "home") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:29.642311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.642279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm" (OuterVolumeSpecName: "dshm") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:29.642405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.642369    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v" (OuterVolumeSpecName: "kube-api-access-x4r6v") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "kube-api-access-x4r6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:29.642454 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.642440    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "489b91a5-7a88-476d-b81a-ced6191d91c6" (UID: "489b91a5-7a88-476d-b81a-ced6191d91c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:29.741099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.741067    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.741099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.741096    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.741099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.741105    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489b91a5-7a88-476d-b81a-ced6191d91c6-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.741099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.741114    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4r6v\" (UniqueName: \"kubernetes.io/projected/489b91a5-7a88-476d-b81a-ced6191d91c6-kube-api-access-x4r6v\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.741099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.741123    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489b91a5-7a88-476d-b81a-ced6191d91c6-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:29.746761 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.746729    2559 generic.go:356] "Generic (PLEG): container finished" podID="489b91a5-7a88-476d-b81a-ced6191d91c6" containerID="196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97" exitCode=0
Sep 10 22:32:29.746761 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.746771    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"
Sep 10 22:32:29.746976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.746814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" event={"ID":"489b91a5-7a88-476d-b81a-ced6191d91c6","Type":"ContainerDied","Data":"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"}
Sep 10 22:32:29.746976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.746853    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6" event={"ID":"489b91a5-7a88-476d-b81a-ced6191d91c6","Type":"ContainerDied","Data":"8a497635ff9740e4a69677a5dd1a103b74885d4a963f5182dfd0e27c75afd767"}
Sep 10 22:32:29.746976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.746876    2559 scope.go:117] "RemoveContainer" containerID="196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"
Sep 10 22:32:29.755957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.755935    2559 scope.go:117] "RemoveContainer" containerID="196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"
Sep 10 22:32:29.756266 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:32:29.756247    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97\": container with ID starting with 196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97 not found: ID does not exist" containerID="196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"
Sep 10 22:32:29.756332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.756274    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97"} err="failed to get container status \"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97\": rpc error: code = NotFound desc = could not find container \"196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97\": container with ID starting with 196f4b0037df662529d00e4b8a052d179ef45c5584d8024bd88359cfb4fa6d97 not found: ID does not exist"
Sep 10 22:32:29.767346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.767310    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:32:29.772731 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.772699    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-481dd50d-kserve-54777579d5-96nq6"]
Sep 10 22:32:29.891668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:29.891586    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="489b91a5-7a88-476d-b81a-ced6191d91c6" path="/var/lib/kubelet/pods/489b91a5-7a88-476d-b81a-ced6191d91c6/volumes"
Sep 10 22:32:37.729482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729448    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"]
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729824    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489b91a5-7a88-476d-b81a-ced6191d91c6" containerName="main"
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729835    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="489b91a5-7a88-476d-b81a-ced6191d91c6" containerName="main"
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729852    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a5602b9-e43f-4248-9dce-3dd478e78151" containerName="main"
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729858    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5602b9-e43f-4248-9dce-3dd478e78151" containerName="main"
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a5602b9-e43f-4248-9dce-3dd478e78151" containerName="main"
Sep 10 22:32:37.729968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.729929    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="489b91a5-7a88-476d-b81a-ced6191d91c6" containerName="main"
Sep 10 22:32:37.733995 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.733975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:37.736426 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.736405    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:32:37.736595 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.736579    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:32:37.739993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.739969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"]
Sep 10 22:32:37.815134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.815097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9\" (UID: \"74174dcd-3b90-405b-9fa0-7867690d2055\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:37.916379 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.916344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9\" (UID: \"74174dcd-3b90-405b-9fa0-7867690d2055\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:37.916969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:37.916951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9\" (UID: \"74174dcd-3b90-405b-9fa0-7867690d2055\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:38.046067 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:38.045984    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:38.316437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:38.316355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"]
Sep 10 22:32:38.319234 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:32:38.319190    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74174dcd_3b90_405b_9fa0_7867690d2055.slice/crio-ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c WatchSource:0}: Error finding container ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c: Status 404 returned error can't find the container with id ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c
Sep 10 22:32:38.793123 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:38.793090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9" event={"ID":"74174dcd-3b90-405b-9fa0-7867690d2055","Type":"ContainerStarted","Data":"8d6f20e370305a25d77329a1d4371d55ee885b96dd138b1c739dd76722be8acb"}
Sep 10 22:32:38.793610 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:38.793148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9" event={"ID":"74174dcd-3b90-405b-9fa0-7867690d2055","Type":"ContainerStarted","Data":"ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c"}
Sep 10 22:32:38.810741 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:38.810689    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9" podStartSLOduration=1.810673275 podStartE2EDuration="1.810673275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:38.809059643 +0000 UTC m=+865.393136684" watchObservedRunningTime="2026-09-10 22:32:38.810673275 +0000 UTC m=+865.394750315"
Sep 10 22:32:39.799788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:39.799747    2559 generic.go:356] "Generic (PLEG): container finished" podID="74174dcd-3b90-405b-9fa0-7867690d2055" containerID="8d6f20e370305a25d77329a1d4371d55ee885b96dd138b1c739dd76722be8acb" exitCode=0
Sep 10 22:32:39.800168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:39.799836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9" event={"ID":"74174dcd-3b90-405b-9fa0-7867690d2055","Type":"ContainerDied","Data":"8d6f20e370305a25d77329a1d4371d55ee885b96dd138b1c739dd76722be8acb"}
Sep 10 22:32:40.938333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:40.938305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:41.046977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.046936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca\") pod \"74174dcd-3b90-405b-9fa0-7867690d2055\" (UID: \"74174dcd-3b90-405b-9fa0-7867690d2055\") "
Sep 10 22:32:41.047328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.047294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74174dcd-3b90-405b-9fa0-7867690d2055" (UID: "74174dcd-3b90-405b-9fa0-7867690d2055"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:41.148520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.148395    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74174dcd-3b90-405b-9fa0-7867690d2055-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:41.817187 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.817137    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"
Sep 10 22:32:41.817187 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.817161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9" event={"ID":"74174dcd-3b90-405b-9fa0-7867690d2055","Type":"ContainerDied","Data":"ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c"}
Sep 10 22:32:41.817406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:41.817231    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea017674c6f0f3f04c7e3f67e9e6d17e64821c1ae9b7825bbe1dd0e8fecca82c"
Sep 10 22:32:44.933005 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:44.932964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.553273 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.553240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.582947 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.582911    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:45.583166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.583121    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" podUID="83a5c280-0203-4da3-a545-f90e473c5043" containerName="payload-processing" containerID="cri-o://f51a0ff34776791d9c96059e17cc39119de7e1afa2d847784ccfe3cde859edf5" gracePeriod=30
Sep 10 22:32:45.591713 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.591687    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:45.591933 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.591907    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" podUID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" containerName="payload-pre-processing" containerID="cri-o://f2d36b50c753c499f6e163ecec855bae71a9f3a01a1b4300e79bb737aeeaa2c2" gracePeriod=30
Sep 10 22:32:45.630702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.630671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.702580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.702551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.778694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.777214    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"]
Sep 10 22:32:45.778694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.778416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.782328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.782301    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e01e31eb-5qht9"]
Sep 10 22:32:45.837482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.837400    2559 generic.go:356] "Generic (PLEG): container finished" podID="83a5c280-0203-4da3-a545-f90e473c5043" containerID="f51a0ff34776791d9c96059e17cc39119de7e1afa2d847784ccfe3cde859edf5" exitCode=0
Sep 10 22:32:45.837660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.837474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" event={"ID":"83a5c280-0203-4da3-a545-f90e473c5043","Type":"ContainerDied","Data":"f51a0ff34776791d9c96059e17cc39119de7e1afa2d847784ccfe3cde859edf5"}
Sep 10 22:32:45.839217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.839191    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" containerID="f2d36b50c753c499f6e163ecec855bae71a9f3a01a1b4300e79bb737aeeaa2c2" exitCode=0
Sep 10 22:32:45.839345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.839260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" event={"ID":"9d2fb7a9-c665-4c65-ba5d-a359ad34e797","Type":"ContainerDied","Data":"f2d36b50c753c499f6e163ecec855bae71a9f3a01a1b4300e79bb737aeeaa2c2"}
Sep 10 22:32:45.841125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.841100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.864460 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.864365    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:45.866481 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.866464    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:45.897774 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.897745    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74174dcd-3b90-405b-9fa0-7867690d2055" path="/var/lib/kubelet/pods/74174dcd-3b90-405b-9fa0-7867690d2055/volumes"
Sep 10 22:32:45.940607 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.940574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:45.995310 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx9kw\" (UniqueName: \"kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw\") pod \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") "
Sep 10 22:32:45.995477 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kds5s\" (UniqueName: \"kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s\") pod \"83a5c280-0203-4da3-a545-f90e473c5043\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") "
Sep 10 22:32:45.995477 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995457    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume\") pod \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\" (UID: \"9d2fb7a9-c665-4c65-ba5d-a359ad34e797\") "
Sep 10 22:32:45.995641 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume\") pod \"83a5c280-0203-4da3-a545-f90e473c5043\" (UID: \"83a5c280-0203-4da3-a545-f90e473c5043\") "
Sep 10 22:32:45.995838 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d2fb7a9-c665-4c65-ba5d-a359ad34e797" (UID: "9d2fb7a9-c665-4c65-ba5d-a359ad34e797"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:45.995949 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995873    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:45.995949 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.995920    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83a5c280-0203-4da3-a545-f90e473c5043" (UID: "83a5c280-0203-4da3-a545-f90e473c5043"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:45.997964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.997946    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s" (OuterVolumeSpecName: "kube-api-access-kds5s") pod "83a5c280-0203-4da3-a545-f90e473c5043" (UID: "83a5c280-0203-4da3-a545-f90e473c5043"). InnerVolumeSpecName "kube-api-access-kds5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:45.998029 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:45.997970    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw" (OuterVolumeSpecName: "kube-api-access-mx9kw") pod "9d2fb7a9-c665-4c65-ba5d-a359ad34e797" (UID: "9d2fb7a9-c665-4c65-ba5d-a359ad34e797"). InnerVolumeSpecName "kube-api-access-mx9kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:46.096547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.096466    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83a5c280-0203-4da3-a545-f90e473c5043-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:46.096547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.096521    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx9kw\" (UniqueName: \"kubernetes.io/projected/9d2fb7a9-c665-4c65-ba5d-a359ad34e797-kube-api-access-mx9kw\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:46.096547 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.096531    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kds5s\" (UniqueName: \"kubernetes.io/projected/83a5c280-0203-4da3-a545-f90e473c5043-kube-api-access-kds5s\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:32:46.230694 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.230660    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:32:46.568557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.568519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.664551 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.664515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.764150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.764110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:46.845373 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.845298    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"
Sep 10 22:32:46.845373 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.845307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2" event={"ID":"83a5c280-0203-4da3-a545-f90e473c5043","Type":"ContainerDied","Data":"4c259e47aa18e7b005e9c088ef33608c53f844f9b70b9f87015b6b1d713aa056"}
Sep 10 22:32:46.845373 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.845364    2559 scope.go:117] "RemoveContainer" containerID="f51a0ff34776791d9c96059e17cc39119de7e1afa2d847784ccfe3cde859edf5"
Sep 10 22:32:46.846772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.846680    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"
Sep 10 22:32:46.846772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.846698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh" event={"ID":"9d2fb7a9-c665-4c65-ba5d-a359ad34e797","Type":"ContainerDied","Data":"f9b5dd316e5e25813e28428193c22ef94bd60ea384088d857b1c73705f4c34a1"}
Sep 10 22:32:46.855359 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.855339    2559 scope.go:117] "RemoveContainer" containerID="f2d36b50c753c499f6e163ecec855bae71a9f3a01a1b4300e79bb737aeeaa2c2"
Sep 10 22:32:46.869906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.869886    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:46.871457 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.871439    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2"]
Sep 10 22:32:46.881577 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.881555    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:46.885475 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:46.885457    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh"]
Sep 10 22:32:47.890559 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:47.890532    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a5c280-0203-4da3-a545-f90e473c5043" path="/var/lib/kubelet/pods/83a5c280-0203-4da3-a545-f90e473c5043/volumes"
Sep 10 22:32:47.890913 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:47.890888    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" path="/var/lib/kubelet/pods/9d2fb7a9-c665-4c65-ba5d-a359ad34e797/volumes"
Sep 10 22:32:48.041371 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:48.041335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:53.856865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:53.856829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:54.010897 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:54.010854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:54.199769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:54.199715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:54.583677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:54.583580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:55.724405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:55.724369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:55.960009 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:55.959976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:56.391068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:56.391037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:56.722691 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:56.722654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:32:57.129167 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:32:57.129064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:00.150426 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:00.150373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:00.243624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:00.243594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:00.948405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:00.948368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:33:01.318221 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.318181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:01.420263 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.420222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:01.844098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.844063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:01.945209 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.945169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:01.967814 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.967782    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:33:01.968135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968122    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74174dcd-3b90-405b-9fa0-7867690d2055" containerName="revoke-keys"
Sep 10 22:33:01.968178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968136    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74174dcd-3b90-405b-9fa0-7867690d2055" containerName="revoke-keys"
Sep 10 22:33:01.968178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968162    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" containerName="payload-pre-processing"
Sep 10 22:33:01.968178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968168    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" containerName="payload-pre-processing"
Sep 10 22:33:01.968178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968175    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a5c280-0203-4da3-a545-f90e473c5043" containerName="payload-processing"
Sep 10 22:33:01.968301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968183    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a5c280-0203-4da3-a545-f90e473c5043" containerName="payload-processing"
Sep 10 22:33:01.968301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968238    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2fb7a9-c665-4c65-ba5d-a359ad34e797" containerName="payload-pre-processing"
Sep 10 22:33:01.968301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968246    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a5c280-0203-4da3-a545-f90e473c5043" containerName="payload-processing"
Sep 10 22:33:01.968301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.968253    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74174dcd-3b90-405b-9fa0-7867690d2055" containerName="revoke-keys"
Sep 10 22:33:01.972541 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.972523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:01.975118 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.975092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-7989d5\""
Sep 10 22:33:01.975232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.975138    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-7989d5-dockercfg-jkvbz\""
Sep 10 22:33:01.978868 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:01.978840    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:33:02.046068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.046041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4txd\" (UniqueName: \"kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.046206 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.046117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.046365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.046341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:02.147068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.146990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4txd\" (UniqueName: \"kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.147068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.147060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.147779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.147757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.154512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.154467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4txd\" (UniqueName: \"kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd\") pod \"payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.304575 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.304540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.575196 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.575167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:33:02.577367 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:33:02.577345    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d01b80_0059_44fa_ad35_7731f531b643.slice/crio-9fd6d439ea1d08189ff4a01a44f26b94f664b6a339c6659ded0e389795a62d62 WatchSource:0}: Error finding container 9fd6d439ea1d08189ff4a01a44f26b94f664b6a339c6659ded0e389795a62d62: Status 404 returned error can't find the container with id 9fd6d439ea1d08189ff4a01a44f26b94f664b6a339c6659ded0e389795a62d62
Sep 10 22:33:02.933081 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.932990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" event={"ID":"07d01b80-0059-44fa-ad35-7731f531b643","Type":"ContainerStarted","Data":"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"}
Sep 10 22:33:02.933081 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.933053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" event={"ID":"07d01b80-0059-44fa-ad35-7731f531b643","Type":"ContainerStarted","Data":"9fd6d439ea1d08189ff4a01a44f26b94f664b6a339c6659ded0e389795a62d62"}
Sep 10 22:33:02.933269 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.933084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:02.949147 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:02.949089    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" podStartSLOduration=1.9490700460000001 podStartE2EDuration="1.949070046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:02.948823123 +0000 UTC m=+889.532900166" watchObservedRunningTime="2026-09-10 22:33:02.949070046 +0000 UTC m=+889.533147087"
Sep 10 22:33:05.934047 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.934017    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:33:05.937436 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.937414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.940749 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.940729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d1a134\"/\"default-dockercfg-sbjdw\""
Sep 10 22:33:05.940878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.940768    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d1a134\"/\"test-model-d1a134-kserve-self-signed-certs\""
Sep 10 22:33:05.940878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.940825    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d1a134\"/\"openshift-service-ca.crt\""
Sep 10 22:33:05.940878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.940771    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d1a134\"/\"kube-root-ca.crt\""
Sep 10 22:33:05.948143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.948117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:33:05.956685 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.956648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:05.974941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.974914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.975034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.975018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.975100 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.975046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.975100 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.975087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.975192 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.975103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:05.975192 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:05.975118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphjz\" (UniqueName: \"kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076256 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076464 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphjz\" (UniqueName: \"kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076464 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076681    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076774 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.076825 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.076776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.078572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.078553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.078879 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.078849    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.084467 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.084443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphjz\" (UniqueName: \"kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz\") pod \"test-model-d1a134-kserve-54c95c6769-bdtxm\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") " pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.247683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.247657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:06.518910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.518832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:33:06.521557 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:33:06.521531    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9afb58da_043d_4491_bbed_a40d9d14d06f.slice/crio-e721b18bc8864147e76c54e3b39f7bed891ab4fc5ec2fcea7e32e6341e6f22ce WatchSource:0}: Error finding container e721b18bc8864147e76c54e3b39f7bed891ab4fc5ec2fcea7e32e6341e6f22ce: Status 404 returned error can't find the container with id e721b18bc8864147e76c54e3b39f7bed891ab4fc5ec2fcea7e32e6341e6f22ce
Sep 10 22:33:06.952628 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.952599    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" event={"ID":"9afb58da-043d-4491-bbed-a40d9d14d06f","Type":"ContainerStarted","Data":"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"}
Sep 10 22:33:06.952987 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.952634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" event={"ID":"9afb58da-043d-4491-bbed-a40d9d14d06f","Type":"ContainerStarted","Data":"e721b18bc8864147e76c54e3b39f7bed891ab4fc5ec2fcea7e32e6341e6f22ce"}
Sep 10 22:33:06.974077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:06.974032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" podStartSLOduration=1.974017279 podStartE2EDuration="1.974017279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:06.972046426 +0000 UTC m=+893.556123480" watchObservedRunningTime="2026-09-10 22:33:06.974017279 +0000 UTC m=+893.558094320"
Sep 10 22:33:13.938996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:13.938972    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:33:16.248824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:16.248785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:16.248824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:16.248832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:16.261436 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:16.261351    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:17.012717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:17.012690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:33:19.143688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:19.143655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:33:20.479619 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:20.479580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:25.091071 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:25.091031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:26.580397 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:26.580349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:26.640475 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:26.640442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:26.725390 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:26.725359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:26.826647 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:26.826607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:34.346622 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:34.346590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:33:38.249423 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.249381    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:33:38.252718 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.252700    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.255054 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.255030    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7989d5\"/\"openshift-service-ca.crt\""
Sep 10 22:33:38.255151 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.255107    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-7989d5\"/\"kube-root-ca.crt\""
Sep 10 22:33:38.255973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.255952    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7989d5\"/\"default-dockercfg-zrr5k\""
Sep 10 22:33:38.256061 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.255994    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-7989d5\"/\"explicit-model-7989d5-kserve-self-signed-certs\""
Sep 10 22:33:38.260000 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.259973    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:33:38.269738 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.269713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:38.330785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.330928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7scd\" (UniqueName: \"kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.330928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.330928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.330928 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.331089 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.330973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431811 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7scd\" (UniqueName: \"kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.431906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.431896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.432134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.432112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.432134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.432126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.432245 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.432170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.434023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.434000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.434282 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.434265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.439541 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.439521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7scd\" (UniqueName: \"kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd\") pod \"explicit-model-7989d5-kserve-7447cb5b9-2kzt6\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") " pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.564284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.564230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:38.834483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:38.834386    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:33:38.837242 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:33:38.837210    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod729367ac_fe20_42b1_81d4_8ecb8a1befcc.slice/crio-379239b12542c1f74afc45b4c675f446f8ec0a77cc94ca9a37f3e9f8ac210379 WatchSource:0}: Error finding container 379239b12542c1f74afc45b4c675f446f8ec0a77cc94ca9a37f3e9f8ac210379: Status 404 returned error can't find the container with id 379239b12542c1f74afc45b4c675f446f8ec0a77cc94ca9a37f3e9f8ac210379
Sep 10 22:33:39.112613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:39.112527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" event={"ID":"729367ac-fe20-42b1-81d4-8ecb8a1befcc","Type":"ContainerStarted","Data":"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"}
Sep 10 22:33:39.112613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:39.112576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" event={"ID":"729367ac-fe20-42b1-81d4-8ecb8a1befcc","Type":"ContainerStarted","Data":"379239b12542c1f74afc45b4c675f446f8ec0a77cc94ca9a37f3e9f8ac210379"}
Sep 10 22:33:39.130886 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:39.130840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" podStartSLOduration=1.130825151 podStartE2EDuration="1.130825151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:39.129242166 +0000 UTC m=+925.713319225" watchObservedRunningTime="2026-09-10 22:33:39.130825151 +0000 UTC m=+925.714902250"
Sep 10 22:33:42.613060 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:42.613023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:48.564686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.564643    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:48.565213 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.564716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:48.577585 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.577558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:48.618045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.618004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:48.683471 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.683440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:48.783859 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.783832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:48.883819 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:48.883753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:49.170338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:49.170271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:33:50.123220 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.123189    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:33:50.140405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.140375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:33:50.238176 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.238146    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"]
Sep 10 22:33:50.241469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.241450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:50.243704 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.243685    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:33:50.243821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.243788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:33:50.249062 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.249025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"]
Sep 10 22:33:50.329035 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.329001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz\" (UID: \"eb29e039-d46c-4f9a-9a9d-3edf228d25f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:50.329177 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:50.329098    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:50.329177 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:50.329168    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:33:50.829151987 +0000 UTC m=+937.413229009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:50.430273 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.430202    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz\" (UID: \"eb29e039-d46c-4f9a-9a9d-3edf228d25f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:50.430792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.430774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz\" (UID: \"eb29e039-d46c-4f9a-9a9d-3edf228d25f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:50.554201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.554151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:50.826435 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:50.826402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"]
Sep 10 22:33:50.829219 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:33:50.829196    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb29e039_d46c_4f9a_9a9d_3edf228d25f9.slice/crio-27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537 WatchSource:0}: Error finding container 27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537: Status 404 returned error can't find the container with id 27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537
Sep 10 22:33:50.833595 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:50.833572    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:50.833680 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:50.833641    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:33:51.833623556 +0000 UTC m=+938.417700576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:51.169510 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:51.169437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz" event={"ID":"eb29e039-d46c-4f9a-9a9d-3edf228d25f9","Type":"ContainerStarted","Data":"44da7a7297e2315e794f03f2a940b22e19bc529e9e25fdcfc4d841072c068a60"}
Sep 10 22:33:51.169815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:51.169509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz" event={"ID":"eb29e039-d46c-4f9a-9a9d-3edf228d25f9","Type":"ContainerStarted","Data":"27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537"}
Sep 10 22:33:51.185645 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:51.185592    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz" podStartSLOduration=1.185577446 podStartE2EDuration="1.185577446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:51.184119006 +0000 UTC m=+937.768196047" watchObservedRunningTime="2026-09-10 22:33:51.185577446 +0000 UTC m=+937.769654486"
Sep 10 22:33:51.842311 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:51.842242    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:51.842311 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:51.842308    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:33:53.842294592 +0000 UTC m=+940.426371610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:52.178226 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:52.178145    2559 generic.go:356] "Generic (PLEG): container finished" podID="eb29e039-d46c-4f9a-9a9d-3edf228d25f9" containerID="44da7a7297e2315e794f03f2a940b22e19bc529e9e25fdcfc4d841072c068a60" exitCode=0
Sep 10 22:33:52.178561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:52.178226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz" event={"ID":"eb29e039-d46c-4f9a-9a9d-3edf228d25f9","Type":"ContainerDied","Data":"44da7a7297e2315e794f03f2a940b22e19bc529e9e25fdcfc4d841072c068a60"}
Sep 10 22:33:53.310297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:53.310272    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:53.455400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:53.455377    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca\") pod \"eb29e039-d46c-4f9a-9a9d-3edf228d25f9\" (UID: \"eb29e039-d46c-4f9a-9a9d-3edf228d25f9\") "
Sep 10 22:33:53.455793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:53.455774    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb29e039-d46c-4f9a-9a9d-3edf228d25f9" (UID: "eb29e039-d46c-4f9a-9a9d-3edf228d25f9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:53.556309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:53.556272    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb29e039-d46c-4f9a-9a9d-3edf228d25f9-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:33:53.639306 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:53.639278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:33:53.858143 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:53.858082    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:53.858143 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:53.858137    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:33:57.858124775 +0000 UTC m=+944.442201793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:54.188683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:54.188618    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"
Sep 10 22:33:54.188683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:54.188635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz" event={"ID":"eb29e039-d46c-4f9a-9a9d-3edf228d25f9","Type":"ContainerDied","Data":"27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537"}
Sep 10 22:33:54.188683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:54.188674    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27f4dc07d804fa4ef371eb3998d78b6f4caa85e9d36e0192d2710b8abad55537"
Sep 10 22:33:57.889431 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:57.889401    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:57.889810 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:33:57.889473    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:34:05.889459121 +0000 UTC m=+952.473536139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:33:59.323904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:33:59.323864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:00.107845 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:00.107814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:00.885453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:00.885417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:00.927076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:00.927047    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:34:00.927275 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:00.927254    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" podUID="07d01b80-0059-44fa-ad35-7731f531b643" containerName="payload-pre-processing" containerID="cri-o://91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499" gracePeriod=30
Sep 10 22:34:00.985743 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:00.985715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:01.086519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.086456    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"]
Sep 10 22:34:01.087915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.087876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:01.088410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.088392    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7989d5-pb9sz"]
Sep 10 22:34:01.155037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.154963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:01.183429 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.183402    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:34:01.222720 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.222695    2559 generic.go:356] "Generic (PLEG): container finished" podID="07d01b80-0059-44fa-ad35-7731f531b643" containerID="91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499" exitCode=0
Sep 10 22:34:01.222866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.222735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"
Sep 10 22:34:01.222866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.222784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" event={"ID":"07d01b80-0059-44fa-ad35-7731f531b643","Type":"ContainerDied","Data":"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"}
Sep 10 22:34:01.222866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.222843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br" event={"ID":"07d01b80-0059-44fa-ad35-7731f531b643","Type":"ContainerDied","Data":"9fd6d439ea1d08189ff4a01a44f26b94f664b6a339c6659ded0e389795a62d62"}
Sep 10 22:34:01.223046 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.222875    2559 scope.go:117] "RemoveContainer" containerID="91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"
Sep 10 22:34:01.231367 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.231349    2559 scope.go:117] "RemoveContainer" containerID="91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"
Sep 10 22:34:01.231677 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:01.231657    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499\": container with ID starting with 91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499 not found: ID does not exist" containerID="91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"
Sep 10 22:34:01.231754 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.231686    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499"} err="failed to get container status \"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499\": rpc error: code = NotFound desc = could not find container \"91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499\": container with ID starting with 91a79f40030b1dde6c4b50ca9b8fad65bcc5fd77e1c37c1ca462adc85a6c1499 not found: ID does not exist"
Sep 10 22:34:01.318281 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.318253    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume\") pod \"07d01b80-0059-44fa-ad35-7731f531b643\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") "
Sep 10 22:34:01.318393 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.318294    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4txd\" (UniqueName: \"kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd\") pod \"07d01b80-0059-44fa-ad35-7731f531b643\" (UID: \"07d01b80-0059-44fa-ad35-7731f531b643\") "
Sep 10 22:34:01.318722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.318698    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "07d01b80-0059-44fa-ad35-7731f531b643" (UID: "07d01b80-0059-44fa-ad35-7731f531b643"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:01.320323 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.320298    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd" (OuterVolumeSpecName: "kube-api-access-h4txd") pod "07d01b80-0059-44fa-ad35-7731f531b643" (UID: "07d01b80-0059-44fa-ad35-7731f531b643"). InnerVolumeSpecName "kube-api-access-h4txd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:01.420113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.420032    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07d01b80-0059-44fa-ad35-7731f531b643-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.420113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.420067    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4txd\" (UniqueName: \"kubernetes.io/projected/07d01b80-0059-44fa-ad35-7731f531b643-kube-api-access-h4txd\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.420870 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.420847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:01.543790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.543757    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:34:01.548117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.548096    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br"]
Sep 10 22:34:01.891723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.891695    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d01b80-0059-44fa-ad35-7731f531b643" path="/var/lib/kubelet/pods/07d01b80-0059-44fa-ad35-7731f531b643/volumes"
Sep 10 22:34:01.892059 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:01.892044    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb29e039-d46c-4f9a-9a9d-3edf228d25f9" path="/var/lib/kubelet/pods/eb29e039-d46c-4f9a-9a9d-3edf228d25f9/volumes"
Sep 10 22:34:05.965550 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:05.965521    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-self-signed-certs: secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:34:05.965897 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:05.965580    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs podName:729367ac-fe20-42b1-81d4-8ecb8a1befcc nodeName:}" failed. No retries permitted until 2026-09-10 22:34:21.965566524 +0000 UTC m=+968.549643541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs") pod "explicit-model-7989d5-kserve-7447cb5b9-2kzt6" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc") : secret "explicit-model-7989d5-kserve-self-signed-certs" not found
Sep 10 22:34:06.075146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.075114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:06.180253 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.180211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:06.188811 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.188783    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" podUID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" containerName="main" containerID="cri-o://46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef" gracePeriod=45
Sep 10 22:34:06.275968 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.275898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:06.376361 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.376318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:06.430044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.430018    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:34:06.469809 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.469781    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.469938 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.469829    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.469938 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.469857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7scd\" (UniqueName: \"kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.469938 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.469902    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.470095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.469943    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.470095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm\") pod \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\" (UID: \"729367ac-fe20-42b1-81d4-8ecb8a1befcc\") "
Sep 10 22:34:06.470205 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470112    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:06.470266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470200    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home" (OuterVolumeSpecName: "home") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:06.470266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache" (OuterVolumeSpecName: "model-cache") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:06.470382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470333    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:06.470382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470346    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:06.470382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.470360    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:06.472104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.472081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm" (OuterVolumeSpecName: "dshm") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:06.472104 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.472081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd" (OuterVolumeSpecName: "kube-api-access-g7scd") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "kube-api-access-g7scd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:06.472233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.472102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "729367ac-fe20-42b1-81d4-8ecb8a1befcc" (UID: "729367ac-fe20-42b1-81d4-8ecb8a1befcc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:06.497543 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.497509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:06.570765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.570704    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/729367ac-fe20-42b1-81d4-8ecb8a1befcc-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:06.570765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.570727    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7scd\" (UniqueName: \"kubernetes.io/projected/729367ac-fe20-42b1-81d4-8ecb8a1befcc-kube-api-access-g7scd\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:06.570765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:06.570739    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/729367ac-fe20-42b1-81d4-8ecb8a1befcc-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:07.101372 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.101337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:07.250284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.250250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:07.254464 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.254439    2559 generic.go:356] "Generic (PLEG): container finished" podID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" containerID="46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef" exitCode=0
Sep 10 22:34:07.254611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.254503    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"
Sep 10 22:34:07.254611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.254523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" event={"ID":"729367ac-fe20-42b1-81d4-8ecb8a1befcc","Type":"ContainerDied","Data":"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"}
Sep 10 22:34:07.254611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.254574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6" event={"ID":"729367ac-fe20-42b1-81d4-8ecb8a1befcc","Type":"ContainerDied","Data":"379239b12542c1f74afc45b4c675f446f8ec0a77cc94ca9a37f3e9f8ac210379"}
Sep 10 22:34:07.254611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.254597    2559 scope.go:117] "RemoveContainer" containerID="46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"
Sep 10 22:34:07.263728 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.263714    2559 scope.go:117] "RemoveContainer" containerID="46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"
Sep 10 22:34:07.263976 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:07.263958    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef\": container with ID starting with 46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef not found: ID does not exist" containerID="46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"
Sep 10 22:34:07.264014 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.263985    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef"} err="failed to get container status \"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef\": rpc error: code = NotFound desc = could not find container \"46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef\": container with ID starting with 46a656d2e0debdf6c93f9a4e798412f8cd7db6663c5b542d6eec11e34738bfef not found: ID does not exist"
Sep 10 22:34:07.282505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.278483    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:34:07.285741 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.285721    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-7989d5/explicit-model-7989d5-kserve-7447cb5b9-2kzt6"]
Sep 10 22:34:07.753629 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.753597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:34:07.891063 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:07.891031    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" path="/var/lib/kubelet/pods/729367ac-fe20-42b1-81d4-8ecb8a1befcc/volumes"
Sep 10 22:34:08.614964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:08.614895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:08.711335 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:08.711305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:08.856946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:08.856913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:09.267003 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:09.266970    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:09.588009 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:09.587932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:09.811983 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:09.811941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:10.984124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:10.984087    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:11.083153 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:11.083121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:11.194886 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:11.194856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:14.376988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:14.376940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:14.477176 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:14.477142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:15.038452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:15.038412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:20.863965 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:20.863924    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:34:21.049020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:21.048990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:21.149443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:21.149364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:21.296661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:21.296634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:21.606566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:21.606530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:21.738795 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:21.738762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:23.528410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:23.528903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528853    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d01b80-0059-44fa-ad35-7731f531b643" containerName="payload-pre-processing"
Sep 10 22:34:23.528903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528872    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d01b80-0059-44fa-ad35-7731f531b643" containerName="payload-pre-processing"
Sep 10 22:34:23.528903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528883    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" containerName="main"
Sep 10 22:34:23.528903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528890    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" containerName="main"
Sep 10 22:34:23.528903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528902    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb29e039-d46c-4f9a-9a9d-3edf228d25f9" containerName="revoke-keys"
Sep 10 22:34:23.529161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.528911    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb29e039-d46c-4f9a-9a9d-3edf228d25f9" containerName="revoke-keys"
Sep 10 22:34:23.529161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.529017    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb29e039-d46c-4f9a-9a9d-3edf228d25f9" containerName="revoke-keys"
Sep 10 22:34:23.529161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.529032    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d01b80-0059-44fa-ad35-7731f531b643" containerName="payload-pre-processing"
Sep 10 22:34:23.529161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.529045    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="729367ac-fe20-42b1-81d4-8ecb8a1befcc" containerName="main"
Sep 10 22:34:23.532951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.532928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.535478 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.535461    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-dfd2f1\"/\"kube-root-ca.crt\""
Sep 10 22:34:23.536407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.536391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-dfd2f1\"/\"default-dockercfg-ksmzf\""
Sep 10 22:34:23.536504 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.536428    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-dfd2f1\"/\"noten-model-dfd2f1-kserve-self-signed-certs\""
Sep 10 22:34:23.536504 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.536452    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-dfd2f1\"/\"openshift-service-ca.crt\""
Sep 10 22:34:23.540906 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.540888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:23.598558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjhtm\" (UniqueName: \"kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.598673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.598673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.598793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.598793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.598888 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.598798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699174 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjhtm\" (UniqueName: \"kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.699792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.699737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.701459 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.701442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.701752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.701736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.706540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.706521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjhtm\" (UniqueName: \"kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm\") pod \"noten-model-dfd2f1-kserve-68448f8c7f-zqsfq\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") " pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:23.834463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.834388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:23.842270 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:23.842247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:24.117863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.117799    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:24.120027 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:34:24.120000    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf8a0570_b06a_44b0_a4c5_b016b8bcb7c4.slice/crio-47d4c416246a6ee52b6f3787ae34daf934acc296008267d36573c72b6e3e5759 WatchSource:0}: Error finding container 47d4c416246a6ee52b6f3787ae34daf934acc296008267d36573c72b6e3e5759: Status 404 returned error can't find the container with id 47d4c416246a6ee52b6f3787ae34daf934acc296008267d36573c72b6e3e5759
Sep 10 22:34:24.336064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.336026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" event={"ID":"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4","Type":"ContainerStarted","Data":"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"}
Sep 10 22:34:24.336233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.336073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" event={"ID":"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4","Type":"ContainerStarted","Data":"47d4c416246a6ee52b6f3787ae34daf934acc296008267d36573c72b6e3e5759"}
Sep 10 22:34:24.355056 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.354206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" podStartSLOduration=1.35418714 podStartE2EDuration="1.35418714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:24.351865499 +0000 UTC m=+970.935942538" watchObservedRunningTime="2026-09-10 22:34:24.35418714 +0000 UTC m=+970.938264182"
Sep 10 22:34:24.684654 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.684613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:24.777584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:24.777554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:25.908741 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:25.908682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:26.051365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.051330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:26.280550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.280518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:26.517387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.517354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:26.612332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.612244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:26.658172 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.658145    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:34:26.661545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.661528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.663881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.663861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b902065f\""
Sep 10 22:34:26.663986 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.663938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b902065f-dockercfg-qm5ms\""
Sep 10 22:34:26.674753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.674729    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:34:26.723919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.723895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.724017 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.723931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76wkp\" (UniqueName: \"kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.825045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.825007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.825169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.825059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76wkp\" (UniqueName: \"kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.825752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.825731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.832619 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.832592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wkp\" (UniqueName: \"kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp\") pod \"payload-processing-e2e-mt-b902065f-784f769d89-vsfmt\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") " pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:26.971527 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:26.971505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:27.242837 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:27.242813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:34:27.244664 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:34:27.244634    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e84e7a_f464_4c76_b808_1bc79eb54fb9.slice/crio-dd29df48d986039cd874627fcd4be688ea4d173c7cdd2447c63446533a0bdcd2 WatchSource:0}: Error finding container dd29df48d986039cd874627fcd4be688ea4d173c7cdd2447c63446533a0bdcd2: Status 404 returned error can't find the container with id dd29df48d986039cd874627fcd4be688ea4d173c7cdd2447c63446533a0bdcd2
Sep 10 22:34:27.357662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:27.357625    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" event={"ID":"88e84e7a-f464-4c76-b808-1bc79eb54fb9","Type":"ContainerStarted","Data":"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"}
Sep 10 22:34:27.357848 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:27.357697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" event={"ID":"88e84e7a-f464-4c76-b808-1bc79eb54fb9","Type":"ContainerStarted","Data":"dd29df48d986039cd874627fcd4be688ea4d173c7cdd2447c63446533a0bdcd2"}
Sep 10 22:34:27.357848 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:27.357838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:27.375867 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:27.375824    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" podStartSLOduration=1.375809853 podStartE2EDuration="1.375809853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:27.374087882 +0000 UTC m=+973.958164922" watchObservedRunningTime="2026-09-10 22:34:27.375809853 +0000 UTC m=+973.959886893"
Sep 10 22:34:28.524298 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:28.524267    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:34:28.544412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:28.544373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:31.020252 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:31.020218    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:31.039867 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:31.039835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:31.166288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:31.166259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:31.384545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:31.384449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:31.493706 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:31.493675    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:32.027204 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.027173    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:34:32.046962 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.046930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:32.154739 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.154712    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"]
Sep 10 22:34:32.158043 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.158024    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:32.160380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.160363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:34:32.160479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.160362    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:34:32.165604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.165258    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"]
Sep 10 22:34:32.271514 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.271464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn\" (UID: \"6921ab61-befe-4b1e-b4e7-0318f482a0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:32.372746 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.372679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn\" (UID: \"6921ab61-befe-4b1e-b4e7-0318f482a0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:32.373271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.373246    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn\" (UID: \"6921ab61-befe-4b1e-b4e7-0318f482a0e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:32.469269 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.469245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:32.491243 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.491212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:32.744831 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:32.744804    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"]
Sep 10 22:34:32.745927 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:34:32.745904    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6921ab61_befe_4b1e_b4e7_0318f482a0e6.slice/crio-4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7 WatchSource:0}: Error finding container 4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7: Status 404 returned error can't find the container with id 4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7
Sep 10 22:34:33.387552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:33.387461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn" event={"ID":"6921ab61-befe-4b1e-b4e7-0318f482a0e6","Type":"ContainerStarted","Data":"132209aeed5543e27ef3778b6c6bb41563bc23aa7b52117ebce564bb5722bd87"}
Sep 10 22:34:33.387552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:33.387537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn" event={"ID":"6921ab61-befe-4b1e-b4e7-0318f482a0e6","Type":"ContainerStarted","Data":"4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7"}
Sep 10 22:34:33.402815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:33.402767    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn" podStartSLOduration=1.402751851 podStartE2EDuration="1.402751851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:33.401899137 +0000 UTC m=+979.985976178" watchObservedRunningTime="2026-09-10 22:34:33.402751851 +0000 UTC m=+979.986828891"
Sep 10 22:34:33.842918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:33.842891    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:34.393470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:34.393435    2559 generic.go:356] "Generic (PLEG): container finished" podID="6921ab61-befe-4b1e-b4e7-0318f482a0e6" containerID="132209aeed5543e27ef3778b6c6bb41563bc23aa7b52117ebce564bb5722bd87" exitCode=0
Sep 10 22:34:34.393839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:34.393521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn" event={"ID":"6921ab61-befe-4b1e-b4e7-0318f482a0e6","Type":"ContainerDied","Data":"132209aeed5543e27ef3778b6c6bb41563bc23aa7b52117ebce564bb5722bd87"}
Sep 10 22:34:35.253427 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:35.253387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:34:35.527419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:35.527387    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:35.602426 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:35.602396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca\") pod \"6921ab61-befe-4b1e-b4e7-0318f482a0e6\" (UID: \"6921ab61-befe-4b1e-b4e7-0318f482a0e6\") "
Sep 10 22:34:35.602734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:35.602714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6921ab61-befe-4b1e-b4e7-0318f482a0e6" (UID: "6921ab61-befe-4b1e-b4e7-0318f482a0e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:35.703218 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:35.703190    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6921ab61-befe-4b1e-b4e7-0318f482a0e6-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.404756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:36.404718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn" event={"ID":"6921ab61-befe-4b1e-b4e7-0318f482a0e6","Type":"ContainerDied","Data":"4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7"}
Sep 10 22:34:36.404921 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:36.404766    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"
Sep 10 22:34:36.404921 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:36.404772    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4092798c8772b148d9ae0fd698137d49435cc92cb330f4302c478ed58f6ea9f7"
Sep 10 22:34:36.694538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:36.694431    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:38.365592 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:38.365557    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:34:42.828999 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:42.828963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:42.927963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:42.927924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:43.028424 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.028389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:43.042452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.042425    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"]
Sep 10 22:34:43.043984 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.043964    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ddf324-cl4nn"]
Sep 10 22:34:43.094206 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.094146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:43.543117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.543079    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" podUID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" containerName="main" containerID="cri-o://473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a" gracePeriod=45
Sep 10 22:34:43.791637 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.791613    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:34:43.867290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf8sj\" (UniqueName: \"kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867279    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867300    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867317    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache\") pod \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\" (UID: \"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5\") "
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867601    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867734    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home" (OuterVolumeSpecName: "home") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867750    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:43.867849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867846    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.868094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867866    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.868094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.867880    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.869604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.869576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm" (OuterVolumeSpecName: "dshm") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:43.869604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.869582    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj" (OuterVolumeSpecName: "kube-api-access-mf8sj") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "kube-api-access-mf8sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:43.869793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.869627    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" (UID: "c27e3b42-afc3-4e73-b0d6-2ef56b096fd5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:43.892427 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.892404    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6921ab61-befe-4b1e-b4e7-0318f482a0e6" path="/var/lib/kubelet/pods/6921ab61-befe-4b1e-b4e7-0318f482a0e6/volumes"
Sep 10 22:34:43.968410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.968390    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.968410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.968411    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf8sj\" (UniqueName: \"kubernetes.io/projected/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-kube-api-access-mf8sj\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.968410 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:43.968420    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:44.444428 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.444396    2559 generic.go:356] "Generic (PLEG): container finished" podID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" containerID="473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a" exitCode=0
Sep 10 22:34:44.444616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.444440    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"
Sep 10 22:34:44.444616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.444508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" event={"ID":"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5","Type":"ContainerDied","Data":"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"}
Sep 10 22:34:44.444616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.444555    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x" event={"ID":"c27e3b42-afc3-4e73-b0d6-2ef56b096fd5","Type":"ContainerDied","Data":"43d1b57bc473bd9d673fada1b20b352c62ba4322826248f17e65606e17fc4cd6"}
Sep 10 22:34:44.444616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.444574    2559 scope.go:117] "RemoveContainer" containerID="473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"
Sep 10 22:34:44.452716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.452698    2559 scope.go:117] "RemoveContainer" containerID="473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"
Sep 10 22:34:44.452977 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:44.452959    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a\": container with ID starting with 473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a not found: ID does not exist" containerID="473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"
Sep 10 22:34:44.453048 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.452982    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a"} err="failed to get container status \"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a\": rpc error: code = NotFound desc = could not find container \"473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a\": container with ID starting with 473f87436562684f69ba10f5d7f3cbe99d2856f489061bc9ed2312d6096b494a not found: ID does not exist"
Sep 10 22:34:44.460887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.460864    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:34:44.467692 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:44.467673    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ddf324/test-model-ddf324-kserve-5857ffcfbc-f6h8x"]
Sep 10 22:34:45.891688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:45.891656    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" path="/var/lib/kubelet/pods/c27e3b42-afc3-4e73-b0d6-2ef56b096fd5/volumes"
Sep 10 22:34:46.042207 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.042174    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" podUID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" containerName="main" containerID="cri-o://fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb" gracePeriod=45
Sep 10 22:34:46.281259 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.281238    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:46.394286 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394259    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjhtm\" (UniqueName: \"kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home\") pod \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\" (UID: \"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4\") "
Sep 10 22:34:46.394686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394633    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:46.394803 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394754    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:46.394854 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.394800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home" (OuterVolumeSpecName: "home") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:46.396503 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.396463    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm" (OuterVolumeSpecName: "dshm") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:46.396591 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.396549    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:46.396644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.396600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm" (OuterVolumeSpecName: "kube-api-access-wjhtm") pod "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" (UID: "df8a0570-b06a-44b0-a4c5-b016b8bcb7c4"). InnerVolumeSpecName "kube-api-access-wjhtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:46.446582 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.446526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:34:46.456878 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.456857    2559 generic.go:356] "Generic (PLEG): container finished" podID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" containerID="fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb" exitCode=0
Sep 10 22:34:46.456982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.456895    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"
Sep 10 22:34:46.456982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.456943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" event={"ID":"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4","Type":"ContainerDied","Data":"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"}
Sep 10 22:34:46.456982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.456978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq" event={"ID":"df8a0570-b06a-44b0-a4c5-b016b8bcb7c4","Type":"ContainerDied","Data":"47d4c416246a6ee52b6f3787ae34daf934acc296008267d36573c72b6e3e5759"}
Sep 10 22:34:46.457076 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.456995    2559 scope.go:117] "RemoveContainer" containerID="fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"
Sep 10 22:34:46.466007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.465986    2559 scope.go:117] "RemoveContainer" containerID="fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"
Sep 10 22:34:46.466276 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:46.466258    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb\": container with ID starting with fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb not found: ID does not exist" containerID="fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"
Sep 10 22:34:46.466355 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.466284    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb"} err="failed to get container status \"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb\": rpc error: code = NotFound desc = could not find container \"fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb\": container with ID starting with fe8a286b3b332efe2ebfe44506dd007bc54b2c71935aac8feb291b6f21048ecb not found: ID does not exist"
Sep 10 22:34:46.477037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.477016    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:46.481075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.481054    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-dfd2f1/noten-model-dfd2f1-kserve-68448f8c7f-zqsfq"]
Sep 10 22:34:46.495678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495659    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.495678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495679    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.495787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495690    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjhtm\" (UniqueName: \"kubernetes.io/projected/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-kube-api-access-wjhtm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.495787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495700    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.495787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495710    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.495787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.495722    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:46.931083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:46.931051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:47.046278 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.046249    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" podUID="9afb58da-043d-4491-bbed-a40d9d14d06f" containerName="main" containerID="cri-o://48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015" gracePeriod=45
Sep 10 22:34:47.290862 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.290837    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:34:47.403597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403622    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gphjz\" (UniqueName: \"kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403958 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs\") pod \"9afb58da-043d-4491-bbed-a40d9d14d06f\" (UID: \"9afb58da-043d-4491-bbed-a40d9d14d06f\") "
Sep 10 22:34:47.403958 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403793    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:47.403958 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403883    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:47.403958 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.403910    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home" (OuterVolumeSpecName: "home") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:47.404094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.404042    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.404094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.404059    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.404094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.404068    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.405941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.405916    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm" (OuterVolumeSpecName: "dshm") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:47.406039 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.405988    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:47.406039 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.405998    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz" (OuterVolumeSpecName: "kube-api-access-gphjz") pod "9afb58da-043d-4491-bbed-a40d9d14d06f" (UID: "9afb58da-043d-4491-bbed-a40d9d14d06f"). InnerVolumeSpecName "kube-api-access-gphjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:47.462815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.462752    2559 generic.go:356] "Generic (PLEG): container finished" podID="9afb58da-043d-4491-bbed-a40d9d14d06f" containerID="48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015" exitCode=0
Sep 10 22:34:47.462815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.462795    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"
Sep 10 22:34:47.462950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.462840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" event={"ID":"9afb58da-043d-4491-bbed-a40d9d14d06f","Type":"ContainerDied","Data":"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"}
Sep 10 22:34:47.462950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.462891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm" event={"ID":"9afb58da-043d-4491-bbed-a40d9d14d06f","Type":"ContainerDied","Data":"e721b18bc8864147e76c54e3b39f7bed891ab4fc5ec2fcea7e32e6341e6f22ce"}
Sep 10 22:34:47.462950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.462917    2559 scope.go:117] "RemoveContainer" containerID="48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"
Sep 10 22:34:47.471955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.471939    2559 scope.go:117] "RemoveContainer" containerID="48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"
Sep 10 22:34:47.472196 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:34:47.472178    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015\": container with ID starting with 48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015 not found: ID does not exist" containerID="48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"
Sep 10 22:34:47.472239 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.472202    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015"} err="failed to get container status \"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015\": rpc error: code = NotFound desc = could not find container \"48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015\": container with ID starting with 48f410d8992fb433910e14cf249e0e611457471bf8d57490867dd6d2d7849015 not found: ID does not exist"
Sep 10 22:34:47.482702 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.482681    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:34:47.486499 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.486463    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d1a134/test-model-d1a134-kserve-54c95c6769-bdtxm"]
Sep 10 22:34:47.504579 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.504562    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9afb58da-043d-4491-bbed-a40d9d14d06f-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.504579 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.504581    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gphjz\" (UniqueName: \"kubernetes.io/projected/9afb58da-043d-4491-bbed-a40d9d14d06f-kube-api-access-gphjz\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.504698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.504590    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9afb58da-043d-4491-bbed-a40d9d14d06f-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:34:47.892007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.891923    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9afb58da-043d-4491-bbed-a40d9d14d06f" path="/var/lib/kubelet/pods/9afb58da-043d-4491-bbed-a40d9d14d06f/volumes"
Sep 10 22:34:47.892318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:47.892302    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" path="/var/lib/kubelet/pods/df8a0570-b06a-44b0-a4c5-b016b8bcb7c4/volumes"
Sep 10 22:34:53.448542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:53.448477    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:54.453658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:54.453624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:59.109334 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.109303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:59.209079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.209046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:59.369476 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.369393    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:59.708281 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708252    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"]
Sep 10 22:34:59.708607 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708594    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" containerName="main"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708610    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" containerName="main"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708620    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6921ab61-befe-4b1e-b4e7-0318f482a0e6" containerName="revoke-keys"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708626    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6921ab61-befe-4b1e-b4e7-0318f482a0e6" containerName="revoke-keys"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708642    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afb58da-043d-4491-bbed-a40d9d14d06f" containerName="main"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708648    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afb58da-043d-4491-bbed-a40d9d14d06f" containerName="main"
Sep 10 22:34:59.708657 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708658    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" containerName="main"
Sep 10 22:34:59.708846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708664    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" containerName="main"
Sep 10 22:34:59.708846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708717    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27e3b42-afc3-4e73-b0d6-2ef56b096fd5" containerName="main"
Sep 10 22:34:59.708846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708725    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afb58da-043d-4491-bbed-a40d9d14d06f" containerName="main"
Sep 10 22:34:59.708846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708732    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8a0570-b06a-44b0-a4c5-b016b8bcb7c4" containerName="main"
Sep 10 22:34:59.708846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.708747    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6921ab61-befe-4b1e-b4e7-0318f482a0e6" containerName="revoke-keys"
Sep 10 22:34:59.713304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.713286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:34:59.715703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.715678    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:34:59.715839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.715797    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:34:59.720945 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.720918    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"]
Sep 10 22:34:59.858272 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.858241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:34:59.897929 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.897905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts\" (UID: \"ffa96455-fdec-4f89-bd15-eb8eeb6addf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:34:59.998860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.998805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts\" (UID: \"ffa96455-fdec-4f89-bd15-eb8eeb6addf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:34:59.999411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:34:59.999391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts\" (UID: \"ffa96455-fdec-4f89-bd15-eb8eeb6addf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:35:00.023934 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:00.023909    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:35:00.292648 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:00.292622    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"]
Sep 10 22:35:00.294567 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:35:00.294541    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa96455_fdec_4f89_bd15_eb8eeb6addf9.slice/crio-7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c WatchSource:0}: Error finding container 7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c: Status 404 returned error can't find the container with id 7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c
Sep 10 22:35:00.530122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:00.530090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts" event={"ID":"ffa96455-fdec-4f89-bd15-eb8eeb6addf9","Type":"ContainerStarted","Data":"393da0b7f603bae5e37d9cc3c2baf80b2a3a6a87374318b3c5dba041d0c87bc4"}
Sep 10 22:35:00.530226 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:00.530147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts" event={"ID":"ffa96455-fdec-4f89-bd15-eb8eeb6addf9","Type":"ContainerStarted","Data":"7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c"}
Sep 10 22:35:00.546919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:00.546823    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts" podStartSLOduration=1.546802859 podStartE2EDuration="1.546802859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:00.544974929 +0000 UTC m=+1007.129051974" watchObservedRunningTime="2026-09-10 22:35:00.546802859 +0000 UTC m=+1007.130879900"
Sep 10 22:35:01.536533 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:01.536473    2559 generic.go:356] "Generic (PLEG): container finished" podID="ffa96455-fdec-4f89-bd15-eb8eeb6addf9" containerID="393da0b7f603bae5e37d9cc3c2baf80b2a3a6a87374318b3c5dba041d0c87bc4" exitCode=0
Sep 10 22:35:01.536936 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:01.536569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts" event={"ID":"ffa96455-fdec-4f89-bd15-eb8eeb6addf9","Type":"ContainerDied","Data":"393da0b7f603bae5e37d9cc3c2baf80b2a3a6a87374318b3c5dba041d0c87bc4"}
Sep 10 22:35:02.671948 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:02.671925    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:35:02.822779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:02.822691    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca\") pod \"ffa96455-fdec-4f89-bd15-eb8eeb6addf9\" (UID: \"ffa96455-fdec-4f89-bd15-eb8eeb6addf9\") "
Sep 10 22:35:02.823044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:02.823019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ffa96455-fdec-4f89-bd15-eb8eeb6addf9" (UID: "ffa96455-fdec-4f89-bd15-eb8eeb6addf9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:02.923480 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:02.923443    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa96455-fdec-4f89-bd15-eb8eeb6addf9-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:35:03.546922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:03.546896    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"
Sep 10 22:35:03.547091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:03.546943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts" event={"ID":"ffa96455-fdec-4f89-bd15-eb8eeb6addf9","Type":"ContainerDied","Data":"7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c"}
Sep 10 22:35:03.547091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:03.546990    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ed9abf6bfac7df58dec9fc99e7e2a18effeb575f3ed34197f3b44d11e7b8f6c"
Sep 10 22:35:05.083077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:05.083047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:05.177847 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:05.177811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:05.531633 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:05.531592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:10.209600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.209562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:10.312800 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.312765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:10.410855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.410816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:10.420854 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.420828    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"]
Sep 10 22:35:10.423290 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.423264    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1a134-lsgts"]
Sep 10 22:35:10.513629 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.513538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:10.779364 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:10.779273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:11.609477 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:11.609438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:11.710081 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:11.710036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:11.890602 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:11.890512    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa96455-fdec-4f89-bd15-eb8eeb6addf9" path="/var/lib/kubelet/pods/ffa96455-fdec-4f89-bd15-eb8eeb6addf9/volumes"
Sep 10 22:35:12.087287 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:12.087253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:13.557256 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:13.557223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:35:14.245744 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:14.245702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:16.747360 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:16.747318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:16.847716 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:16.847684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.050765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:17.050685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.618086 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:17.618049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:17.936414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:17.936343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:18.226188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:18.226155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:20.672135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:20.672095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:20.764288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:20.764257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:21.848106 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:21.848073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:21.938394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:21.938365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.038270 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.038243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.410002 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.409974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.511065 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.511036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.732753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.732713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.769142 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.769112    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:35:22.769392 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.769367    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" podUID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" containerName="payload-processing" containerID="cri-o://339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4" gracePeriod=30
Sep 10 22:35:22.815763 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.815725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:22.915544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:22.915515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:23.018264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.018242    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:35:23.049482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.049457    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:23.080525 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.080481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76wkp\" (UniqueName: \"kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp\") pod \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") "
Sep 10 22:35:23.080646 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.080625    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume\") pod \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\" (UID: \"88e84e7a-f464-4c76-b808-1bc79eb54fb9\") "
Sep 10 22:35:23.080957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.080931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88e84e7a-f464-4c76-b808-1bc79eb54fb9" (UID: "88e84e7a-f464-4c76-b808-1bc79eb54fb9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:23.082401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.082379    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp" (OuterVolumeSpecName: "kube-api-access-76wkp") pod "88e84e7a-f464-4c76-b808-1bc79eb54fb9" (UID: "88e84e7a-f464-4c76-b808-1bc79eb54fb9"). InnerVolumeSpecName "kube-api-access-76wkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:23.181679 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.181653    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88e84e7a-f464-4c76-b808-1bc79eb54fb9-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.181784 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.181682    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76wkp\" (UniqueName: \"kubernetes.io/projected/88e84e7a-f464-4c76-b808-1bc79eb54fb9-kube-api-access-76wkp\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.346184 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.346107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:23.646180 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.646112    2559 generic.go:356] "Generic (PLEG): container finished" podID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" containerID="339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4" exitCode=0
Sep 10 22:35:23.646180 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.646144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" event={"ID":"88e84e7a-f464-4c76-b808-1bc79eb54fb9","Type":"ContainerDied","Data":"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"}
Sep 10 22:35:23.646180 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.646153    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"
Sep 10 22:35:23.646346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.646186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt" event={"ID":"88e84e7a-f464-4c76-b808-1bc79eb54fb9","Type":"ContainerDied","Data":"dd29df48d986039cd874627fcd4be688ea4d173c7cdd2447c63446533a0bdcd2"}
Sep 10 22:35:23.646346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.646209    2559 scope.go:117] "RemoveContainer" containerID="339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"
Sep 10 22:35:23.655446 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.655428    2559 scope.go:117] "RemoveContainer" containerID="339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"
Sep 10 22:35:23.655756 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:35:23.655735    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4\": container with ID starting with 339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4 not found: ID does not exist" containerID="339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"
Sep 10 22:35:23.655816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.655763    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4"} err="failed to get container status \"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4\": rpc error: code = NotFound desc = could not find container \"339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4\": container with ID starting with 339aa44ea68f4613b54a01237c3f3cc4b308cd5d01f84cc7d3c996b2427047b4 not found: ID does not exist"
Sep 10 22:35:23.669271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.669250    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:35:23.674133 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.674115    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt"]
Sep 10 22:35:23.891908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:23.891877    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" path="/var/lib/kubelet/pods/88e84e7a-f464-4c76-b808-1bc79eb54fb9/volumes"
Sep 10 22:35:25.640317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:25.640282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:35:29.133790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.133745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:29.233496 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.233456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:29.382624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.382594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:29.735561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.735522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:29.834521 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.834479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:29.956537 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:29.956508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:35.766113 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:35.766077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:35.874390 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:35.874360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:35.968065 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:35.968036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:36.125769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:36.125699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:41.733688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:41.733651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:41.834098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:41.834067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:42.617796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:42.617764    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:42.945096 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:42.945023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:43.255482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:43.255449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.626117 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:45.626088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:45.941313 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:45.941234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:46.176479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:46.176446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:46.263046 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:46.263019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:46.365173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:46.365139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:46.524614 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:46.524523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:47.530692 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:47.530665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:47.596751 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:47.596719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:47.944427 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:47.944343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:48.137750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.137713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:48.240383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.240352    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:48.247372 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247345    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:35:48.247738 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247722    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" containerName="payload-processing"
Sep 10 22:35:48.247839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247740    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" containerName="payload-processing"
Sep 10 22:35:48.247839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247755    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa96455-fdec-4f89-bd15-eb8eeb6addf9" containerName="revoke-keys"
Sep 10 22:35:48.247839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247763    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa96455-fdec-4f89-bd15-eb8eeb6addf9" containerName="revoke-keys"
Sep 10 22:35:48.247993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247859    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e84e7a-f464-4c76-b808-1bc79eb54fb9" containerName="payload-processing"
Sep 10 22:35:48.247993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.247876    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa96455-fdec-4f89-bd15-eb8eeb6addf9" containerName="revoke-keys"
Sep 10 22:35:48.250745 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.250727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.253080 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.253062    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-7a7e94\""
Sep 10 22:35:48.253286 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.253269    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-7a7e94-dockercfg-w7v29\""
Sep 10 22:35:48.262888 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.262864    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:35:48.265898 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.265873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:35:48.269436 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.269418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.278108 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.278082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:35:48.364227 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.364199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czt9w\" (UniqueName: \"kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.364366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.364262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.364366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.364286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.364366 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.364311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxpp5\" (UniqueName: \"kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.464994 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.464964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxpp5\" (UniqueName: \"kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.465101 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.465008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt9w\" (UniqueName: \"kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.465101 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.465057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.465101 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.465086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.465969 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.465948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.466018 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.465948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.472519 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.472483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxpp5\" (UniqueName: \"kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5\") pod \"payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.472625 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.472609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czt9w\" (UniqueName: \"kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w\") pod \"payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.560628 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.560565    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:48.580359 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.580338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:48.831376 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.831333    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:35:48.833462 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:35:48.833436    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c1ac9_0548_49b4_b5e6_6834c56fc1f0.slice/crio-5bfeca6ae9b3eb4f5f789cf5f305ac825f5280e5575ae0ff2d337929d6bd2d0e WatchSource:0}: Error finding container 5bfeca6ae9b3eb4f5f789cf5f305ac825f5280e5575ae0ff2d337929d6bd2d0e: Status 404 returned error can't find the container with id 5bfeca6ae9b3eb4f5f789cf5f305ac825f5280e5575ae0ff2d337929d6bd2d0e
Sep 10 22:35:48.860150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:48.860123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:35:48.862689 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:35:48.862668    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907e5e4e_3555_4a74_9333_7e510c3caab8.slice/crio-b55ae246ab010447fe82f17eb9cc2e55953f147fb5ffc92fef1e150d1a3c18c0 WatchSource:0}: Error finding container b55ae246ab010447fe82f17eb9cc2e55953f147fb5ffc92fef1e150d1a3c18c0: Status 404 returned error can't find the container with id b55ae246ab010447fe82f17eb9cc2e55953f147fb5ffc92fef1e150d1a3c18c0
Sep 10 22:35:49.204135 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.204101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:49.302434 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.302400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:49.777433 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.777401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" event={"ID":"907e5e4e-3555-4a74-9333-7e510c3caab8","Type":"ContainerStarted","Data":"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"}
Sep 10 22:35:49.777891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.777466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:35:49.777891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.777501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" event={"ID":"907e5e4e-3555-4a74-9333-7e510c3caab8","Type":"ContainerStarted","Data":"b55ae246ab010447fe82f17eb9cc2e55953f147fb5ffc92fef1e150d1a3c18c0"}
Sep 10 22:35:49.779025 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.779001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" event={"ID":"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0","Type":"ContainerStarted","Data":"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"}
Sep 10 22:35:49.779159 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.779045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" event={"ID":"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0","Type":"ContainerStarted","Data":"5bfeca6ae9b3eb4f5f789cf5f305ac825f5280e5575ae0ff2d337929d6bd2d0e"}
Sep 10 22:35:49.779159 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.779073    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:35:49.793823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.793776    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" podStartSLOduration=1.7937612710000002 podStartE2EDuration="1.793761271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:49.792675805 +0000 UTC m=+1056.376752845" watchObservedRunningTime="2026-09-10 22:35:49.793761271 +0000 UTC m=+1056.377838309"
Sep 10 22:35:49.808775 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:49.808732    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" podStartSLOduration=1.8087197879999999 podStartE2EDuration="1.808719788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:49.807121849 +0000 UTC m=+1056.391198890" watchObservedRunningTime="2026-09-10 22:35:49.808719788 +0000 UTC m=+1056.392796826"
Sep 10 22:35:50.347993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:50.347958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:50.419544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:50.419512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:50.520041 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:50.520004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:50.921866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:50.921836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:50.988656 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:50.988626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:35:53.666862 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:35:53.666830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:36:00.785664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:00.785630    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:36:00.786116 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:00.785906    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:36:02.316824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:02.316791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:02.423140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:02.423109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:08.584263 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:08.584185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.100651 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.100611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.248191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.248162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.348552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.348520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.450508 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.450462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.551582 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.551556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:11.706132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:11.706053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:12.029614 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:12.029525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:14.099316 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:14.099289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:15.043148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:15.043108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:15.141258 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:15.141220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:16.318266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:16.318218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:16.418168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:16.418136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:16.875620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:16.875585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:16.975568 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:16.975533    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:17.019158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.019128    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:36:17.023631 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.023612    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.026095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.026078    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-25e5bd\""
Sep 10 22:36:17.026095 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.026084    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-25e5bd-dockercfg-4s7hg\""
Sep 10 22:36:17.035445 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.035426    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:36:17.051686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.051663    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:36:17.054732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.054713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.070304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.070285    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:36:17.076695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.076662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:17.176624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.176565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.176722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.176641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trp74\" (UniqueName: \"kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.176722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.176661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.176722 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.176682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tgzv\" (UniqueName: \"kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.277583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.277555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trp74\" (UniqueName: \"kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.277684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.277587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.277684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.277610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tgzv\" (UniqueName: \"kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.277684 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.277635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.278246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.278229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.278284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.278268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.288444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.288424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tgzv\" (UniqueName: \"kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv\") pod \"payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.288570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.288553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trp74\" (UniqueName: \"kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74\") pod \"payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.333443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.333423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.364150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.364127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.606103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.606078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:36:17.607732 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:36:17.607707    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74255b0_ad56_4a76_92a2_e4644f1334b2.slice/crio-865ad9368cfbc5cb42064eeb40bcfcaddf2100bed0bf740fa8984c4eedfc0e2d WatchSource:0}: Error finding container 865ad9368cfbc5cb42064eeb40bcfcaddf2100bed0bf740fa8984c4eedfc0e2d: Status 404 returned error can't find the container with id 865ad9368cfbc5cb42064eeb40bcfcaddf2100bed0bf740fa8984c4eedfc0e2d
Sep 10 22:36:17.644955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.644936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:36:17.646455 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:36:17.646433    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5c1af1_8d3b_422d_8805_a23fa232997f.slice/crio-01938a35256345730ef9877b786c596c32c6b1c9756dbb6a1f9fc0b000a9fafd WatchSource:0}: Error finding container 01938a35256345730ef9877b786c596c32c6b1c9756dbb6a1f9fc0b000a9fafd: Status 404 returned error can't find the container with id 01938a35256345730ef9877b786c596c32c6b1c9756dbb6a1f9fc0b000a9fafd
Sep 10 22:36:17.913500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.913401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" event={"ID":"3a5c1af1-8d3b-422d-8805-a23fa232997f","Type":"ContainerStarted","Data":"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"}
Sep 10 22:36:17.913500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.913473    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:17.913734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.913513    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" event={"ID":"3a5c1af1-8d3b-422d-8805-a23fa232997f","Type":"ContainerStarted","Data":"01938a35256345730ef9877b786c596c32c6b1c9756dbb6a1f9fc0b000a9fafd"}
Sep 10 22:36:17.915201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.915175    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" event={"ID":"f74255b0-ad56-4a76-92a2-e4644f1334b2","Type":"ContainerStarted","Data":"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"}
Sep 10 22:36:17.915345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.915221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" event={"ID":"f74255b0-ad56-4a76-92a2-e4644f1334b2","Type":"ContainerStarted","Data":"865ad9368cfbc5cb42064eeb40bcfcaddf2100bed0bf740fa8984c4eedfc0e2d"}
Sep 10 22:36:17.915345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.915270    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:17.933042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.933002    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" podStartSLOduration=0.932987187 podStartE2EDuration="932.987187ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:17.931968009 +0000 UTC m=+1084.516045049" watchObservedRunningTime="2026-09-10 22:36:17.932987187 +0000 UTC m=+1084.517064226"
Sep 10 22:36:17.948552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:17.948514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" podStartSLOduration=0.948482759 podStartE2EDuration="948.482759ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:17.948074514 +0000 UTC m=+1084.532151556" watchObservedRunningTime="2026-09-10 22:36:17.948482759 +0000 UTC m=+1084.532559834"
Sep 10 22:36:23.559772 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:23.559737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:36:24.239955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.239925    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:36:24.244422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.244406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.246982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.246956    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"kube-root-ca.crt\""
Sep 10 22:36:24.247131 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.247020    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"openshift-service-ca.crt\""
Sep 10 22:36:24.247939 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.247922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"default-dockercfg-dr76r\""
Sep 10 22:36:24.248069 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.247957    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"auth-test-model-58cd39-kserve-self-signed-certs\""
Sep 10 22:36:24.252728 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.252705    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:36:24.266388 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.266359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:24.335484 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.335603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dgkj\" (UniqueName: \"kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.335603 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335579    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.335677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.335677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.335744 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.335698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436353 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436704 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dgkj\" (UniqueName: \"kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436831 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436901 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.436954 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.436914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.439034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.439014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.439122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.439054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.449125 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.449099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dgkj\" (UniqueName: \"kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj\") pod \"auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.555544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.555460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:24.832121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.832095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:36:24.834195 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:36:24.834162    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod240799a8_297c_480d_b021_aa3cf8bb22c4.slice/crio-b3d2aac5a5ed8c5a198659fef47ac2e330bd9540848ecf93ebb0eba036e53ea4 WatchSource:0}: Error finding container b3d2aac5a5ed8c5a198659fef47ac2e330bd9540848ecf93ebb0eba036e53ea4: Status 404 returned error can't find the container with id b3d2aac5a5ed8c5a198659fef47ac2e330bd9540848ecf93ebb0eba036e53ea4
Sep 10 22:36:24.949170 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.949130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" event={"ID":"240799a8-297c-480d-b021-aa3cf8bb22c4","Type":"ContainerStarted","Data":"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"}
Sep 10 22:36:24.949320 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.949186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" event={"ID":"240799a8-297c-480d-b021-aa3cf8bb22c4","Type":"ContainerStarted","Data":"b3d2aac5a5ed8c5a198659fef47ac2e330bd9540848ecf93ebb0eba036e53ea4"}
Sep 10 22:36:24.993713 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:24.993664    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" podStartSLOduration=0.993648401 podStartE2EDuration="993.648401ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:24.992709886 +0000 UTC m=+1091.576786926" watchObservedRunningTime="2026-09-10 22:36:24.993648401 +0000 UTC m=+1091.577725505"
Sep 10 22:36:28.922036 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:28.922000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:36:28.922444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:28.922156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:36:34.555905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:34.555861    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:34.556405 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:34.555924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:34.568727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:34.568702    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:35.014416 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:35.014387    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:36:38.851526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:38.851477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:36:40.039800 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:40.039745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:51.523330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:51.523299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:51.824591 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:51.824515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:52.073401 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.073359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:52.445987 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.445947    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:36:52.449501 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.449475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.452521 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.452496    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"openshift-service-ca.crt\""
Sep 10 22:36:52.452627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.452499    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"default-dockercfg-8fjss\""
Sep 10 22:36:52.453220 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.453203    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"kube-root-ca.crt\""
Sep 10 22:36:52.453294 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.453267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"auth-test-model-33b4cf-kserve-self-signed-certs\""
Sep 10 22:36:52.463712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.463687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:36:52.551032 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.551002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:52.559059 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.559175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.559175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.559175 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4fzc\" (UniqueName: \"kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.559297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.559297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.559274    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.659978    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4fzc\" (UniqueName: \"kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660699 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.660699 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.660598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.662330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.662300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.662545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.662530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.668616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.668593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4fzc\" (UniqueName: \"kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc\") pod \"auth-test-model-33b4cf-kserve-86b8968c67-fc8j2\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:52.758840 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:52.758808    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:36:53.028903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:53.028878    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:36:53.030561 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:36:53.030536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69cc44dc_3370_4d69_ad2c_7ad77cf3a7a4.slice/crio-741ba8a4a17fe0b3467832f555f6470880c58a39283d255d2c07cc54c82483b4 WatchSource:0}: Error finding container 741ba8a4a17fe0b3467832f555f6470880c58a39283d255d2c07cc54c82483b4: Status 404 returned error can't find the container with id 741ba8a4a17fe0b3467832f555f6470880c58a39283d255d2c07cc54c82483b4
Sep 10 22:36:53.095363 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:53.095338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" event={"ID":"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4","Type":"ContainerStarted","Data":"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"}
Sep 10 22:36:53.095525 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:53.095374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" event={"ID":"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4","Type":"ContainerStarted","Data":"741ba8a4a17fe0b3467832f555f6470880c58a39283d255d2c07cc54c82483b4"}
Sep 10 22:36:53.113417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:53.113363    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" podStartSLOduration=1.1133487579999999 podStartE2EDuration="1.113348758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:53.112824178 +0000 UTC m=+1119.696901229" watchObservedRunningTime="2026-09-10 22:36:53.113348758 +0000 UTC m=+1119.697425826"
Sep 10 22:36:55.289371 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:55.289340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:55.391230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:55.391197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:56.574161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:56.574119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:56.675771 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:56.675733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:56.911734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:56.911643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:57.036027 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:57.035998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:57.135098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:57.135063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:36:57.750569 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:36:57.750534    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:37:02.759668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:02.759631    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:37:02.760267 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:02.759691    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:37:02.771890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:02.771860    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:37:03.157041 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:03.156963    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:37:13.942083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:13.942048    2559 scope.go:117] "RemoveContainer" containerID="ec525669b38b5772573dfc43c7727745aea72aaa2f3ae7c95ddcc8f8773cb702"
Sep 10 22:37:18.545102 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:18.545065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:37:20.220396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:20.220356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:33.351436 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.351390    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:37:33.356298 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.356279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.359852 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.359831    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-022f2a6a\"/\"openshift-service-ca.crt\""
Sep 10 22:37:33.360075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.360060    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-022f2a6a\"/\"kube-root-ca.crt\""
Sep 10 22:37:33.360144 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.360081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-022f2a6a\"/\"e2e-lifecycle-model-022f2a6a-kserve-self-signed-certs\""
Sep 10 22:37:33.360205 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.360185    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-022f2a6a\"/\"default-dockercfg-pw5gf\""
Sep 10 22:37:33.365210 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.365187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:37:33.383233 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.383210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:33.415265 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.415377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.415377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.415377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.415377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.415616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.415370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzdh\" (UniqueName: \"kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzdh\" (UniqueName: \"kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516740 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516740 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.516806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.516746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.518584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.518560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.518851 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.518835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.524376 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.524354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzdh\" (UniqueName: \"kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh\") pod \"e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") " pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.666282 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.666213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:33.936698 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:33.936668    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:37:33.938909 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:37:33.938883    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45383cd2_2bd6_47a6_b1e0_a1573f7ed0b9.slice/crio-3a4c1d26db4ef7009707aa3b318336b285f631163f3f2d715ae294a058f9a6ca WatchSource:0}: Error finding container 3a4c1d26db4ef7009707aa3b318336b285f631163f3f2d715ae294a058f9a6ca: Status 404 returned error can't find the container with id 3a4c1d26db4ef7009707aa3b318336b285f631163f3f2d715ae294a058f9a6ca
Sep 10 22:37:34.304049 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:34.304010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" event={"ID":"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9","Type":"ContainerStarted","Data":"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"}
Sep 10 22:37:34.304049 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:34.304062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" event={"ID":"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9","Type":"ContainerStarted","Data":"3a4c1d26db4ef7009707aa3b318336b285f631163f3f2d715ae294a058f9a6ca"}
Sep 10 22:37:34.323124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:34.323074    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" podStartSLOduration=1.323059836 podStartE2EDuration="1.323059836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:37:34.32101416 +0000 UTC m=+1160.905091202" watchObservedRunningTime="2026-09-10 22:37:34.323059836 +0000 UTC m=+1160.907136875"
Sep 10 22:37:38.246915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:38.246833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:37:43.365328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:43.365293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:43.666635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:43.666536    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:43.666635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:43.666590    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:43.678922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:43.678899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:44.367917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:44.367889    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:37:45.644982 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:45.644950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:37:58.039760 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:37:58.039719    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:38:04.749201 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.749171    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"]
Sep 10 22:38:04.752865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.752844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:04.757242 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.757219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:38:04.757358 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.757240    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:38:04.762448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.762424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"]
Sep 10 22:38:04.871560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.871533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p\" (UID: \"d7f9a8ce-bec3-4466-9af9-d28f82ac428a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:04.973037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.972995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p\" (UID: \"d7f9a8ce-bec3-4466-9af9-d28f82ac428a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:04.973663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:04.973643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p\" (UID: \"d7f9a8ce-bec3-4466-9af9-d28f82ac428a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:05.024563 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:05.024454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:05.064304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:05.064277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:05.337635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:05.337512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"]
Sep 10 22:38:05.340313 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:38:05.340288    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f9a8ce_bec3_4466_9af9_d28f82ac428a.slice/crio-43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e WatchSource:0}: Error finding container 43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e: Status 404 returned error can't find the container with id 43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e
Sep 10 22:38:05.464204 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:05.464174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p" event={"ID":"d7f9a8ce-bec3-4466-9af9-d28f82ac428a","Type":"ContainerStarted","Data":"43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e"}
Sep 10 22:38:06.470347 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:06.470314    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7f9a8ce-bec3-4466-9af9-d28f82ac428a" containerID="897b74a42d19e627bf1259ae6683776e84076fefe9788e9281ea9cc691ff93bd" exitCode=0
Sep 10 22:38:06.470743 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:06.470369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p" event={"ID":"d7f9a8ce-bec3-4466-9af9-d28f82ac428a","Type":"ContainerDied","Data":"897b74a42d19e627bf1259ae6683776e84076fefe9788e9281ea9cc691ff93bd"}
Sep 10 22:38:07.609564 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:07.609543    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:07.696085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:07.696046    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca\") pod \"d7f9a8ce-bec3-4466-9af9-d28f82ac428a\" (UID: \"d7f9a8ce-bec3-4466-9af9-d28f82ac428a\") "
Sep 10 22:38:07.696406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:07.696382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7f9a8ce-bec3-4466-9af9-d28f82ac428a" (UID: "d7f9a8ce-bec3-4466-9af9-d28f82ac428a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:38:07.797093 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:07.797034    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7f9a8ce-bec3-4466-9af9-d28f82ac428a-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:08.481632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:08.481600    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"
Sep 10 22:38:08.481792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:08.481600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p" event={"ID":"d7f9a8ce-bec3-4466-9af9-d28f82ac428a","Type":"ContainerDied","Data":"43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e"}
Sep 10 22:38:08.481792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:08.481742    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43750a09ba0e07a9046a14f06b996d4db1d95bf700b04568498e81d7255f8f6e"
Sep 10 22:38:13.960779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:13.960750    2559 scope.go:117] "RemoveContainer" containerID="2a3f116ee79bdf97eae714dbea4291d6f8a0e41079a49b770934b9b187cc5445"
Sep 10 22:38:13.968472 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:13.968456    2559 scope.go:117] "RemoveContainer" containerID="4073069c7f9366bea66495fb556df32e07cfa9b59b34a46899b9c4fa8602d716"
Sep 10 22:38:13.975422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:13.975405    2559 scope.go:117] "RemoveContainer" containerID="a502b08e4fd1db7436d28a6f459e792428f2a23a29d97642c3dbd966283061f2"
Sep 10 22:38:17.645512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:17.645462    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:38:20.387099 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.387063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:20.486950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.486920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:20.589134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.589100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:20.596695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.596670    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"]
Sep 10 22:38:20.603402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.603369    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-022f2a6a-77m5p"]
Sep 10 22:38:20.659163 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:20.659090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:21.891398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:21.891366    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f9a8ce-bec3-4466-9af9-d28f82ac428a" path="/var/lib/kubelet/pods/d7f9a8ce-bec3-4466-9af9-d28f82ac428a/volumes"
Sep 10 22:38:23.594227 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:23.594195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:28.576286 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:28.576251    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:38:28.669375 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:28.669337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:36.540279 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:36.540247    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:38:43.595225 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.595187    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" podUID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" containerName="main" containerID="cri-o://3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8" gracePeriod=45
Sep 10 22:38:43.843522 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.843500    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:38:43.889408 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889332    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889408 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889419    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889480    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmzdh\" (UniqueName: \"kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889531    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache\") pod \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\" (UID: \"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9\") "
Sep 10 22:38:43.889846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home" (OuterVolumeSpecName: "home") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:38:43.890006 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889972    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache" (OuterVolumeSpecName: "model-cache") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:38:43.890006 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.889987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:38:43.891774 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.891740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm" (OuterVolumeSpecName: "dshm") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:38:43.891875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.891778    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:38:43.892062 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.892045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh" (OuterVolumeSpecName: "kube-api-access-jmzdh") pod "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" (UID: "45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9"). InnerVolumeSpecName "kube-api-access-jmzdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:38:43.990919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990883    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:43.990919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990910    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:43.990919 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990922    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:43.991148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990932    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:43.991148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990944    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmzdh\" (UniqueName: \"kubernetes.io/projected/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-kube-api-access-jmzdh\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:43.991148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:43.990956    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:38:44.661937 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.661899    2559 generic.go:356] "Generic (PLEG): container finished" podID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" containerID="3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8" exitCode=0
Sep 10 22:38:44.662332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.661952    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"
Sep 10 22:38:44.662332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.661956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" event={"ID":"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9","Type":"ContainerDied","Data":"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"}
Sep 10 22:38:44.662332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.661995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b" event={"ID":"45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9","Type":"ContainerDied","Data":"3a4c1d26db4ef7009707aa3b318336b285f631163f3f2d715ae294a058f9a6ca"}
Sep 10 22:38:44.662332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.662018    2559 scope.go:117] "RemoveContainer" containerID="3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"
Sep 10 22:38:44.672777 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.672754    2559 scope.go:117] "RemoveContainer" containerID="3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"
Sep 10 22:38:44.673055 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:38:44.673037    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8\": container with ID starting with 3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8 not found: ID does not exist" containerID="3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"
Sep 10 22:38:44.673103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.673064    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8"} err="failed to get container status \"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8\": rpc error: code = NotFound desc = could not find container \"3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8\": container with ID starting with 3f80d785231a2cd7d972175d0c84459a4b0a72786d685b46a0fae0ab43805bf8 not found: ID does not exist"
Sep 10 22:38:44.680558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.680531    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:38:44.689170 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:44.685695    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-022f2a6a/e2e-lifecycle-model-022f2a6a-kserve-5f94698c6c-f5j2b"]
Sep 10 22:38:45.891178 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:45.891147    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" path="/var/lib/kubelet/pods/45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9/volumes"
Sep 10 22:38:50.184726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:50.184686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:38:53.644173 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:38:53.644131    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:39:04.712914 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:04.712877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:05.750949 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:05.750910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:07.123930 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:07.123894    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:39:07.133393 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:07.133356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:08.125894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:08.125859    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:39:08.142884 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:08.142838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:10.344755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:10.344718    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:39:11.220176 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:11.220141    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:11.320613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:11.320574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:11.570034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:11.569947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:12.717960 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:12.717919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:12.815950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:12.815919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:12.916752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:12.916719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:13.469246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.469210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:13.568350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.568320    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:13.655147 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655113    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:39:13.655631 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655614    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" containerName="main"
Sep 10 22:39:13.655696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655635    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" containerName="main"
Sep 10 22:39:13.655696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655660    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f9a8ce-bec3-4466-9af9-d28f82ac428a" containerName="revoke-keys"
Sep 10 22:39:13.655696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655669    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f9a8ce-bec3-4466-9af9-d28f82ac428a" containerName="revoke-keys"
Sep 10 22:39:13.655813 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655780    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f9a8ce-bec3-4466-9af9-d28f82ac428a" containerName="revoke-keys"
Sep 10 22:39:13.655813 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.655791    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="45383cd2-2bd6-47a6-b1e0-a1573f7ed0b9" containerName="main"
Sep 10 22:39:13.659020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.659003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.661406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.661387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"sub-test-model-58cd39-kserve-self-signed-certs\""
Sep 10 22:39:13.666726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.666701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:39:13.668965 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.668941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:13.752606 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqn2\" (UniqueName: \"kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.752606 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.752963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.752963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.752963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.752963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.752777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.767800 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.767776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:13.854022 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.853987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854154 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854154 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854154 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqn2\" (UniqueName: \"kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854154 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854154 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854413 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854478 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.854545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.854525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.856283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.856263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.856642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.856625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"sub-test-model-58cd39-kserve-self-signed-certs\""
Sep 10 22:39:13.862456 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.862439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqn2\" (UniqueName: \"kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.866565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.866540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs\") pod \"sub-test-model-58cd39-kserve-77989897c9-kpckm\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:13.968869 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:13.968843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:14.000091 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.000059    2559 scope.go:117] "RemoveContainer" containerID="8d6f20e370305a25d77329a1d4371d55ee885b96dd138b1c739dd76722be8acb"
Sep 10 22:39:14.245087 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.245058    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:39:14.246628 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:39:14.246604    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5eb3d112_1b6e_4071_bae6_f8c64c6263ca.slice/crio-663c2357e921d6930f5d3fd8b2362e773265e9f0e27b2646966a993d51a0c06e WatchSource:0}: Error finding container 663c2357e921d6930f5d3fd8b2362e773265e9f0e27b2646966a993d51a0c06e: Status 404 returned error can't find the container with id 663c2357e921d6930f5d3fd8b2362e773265e9f0e27b2646966a993d51a0c06e
Sep 10 22:39:14.812283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.812249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" event={"ID":"5eb3d112-1b6e-4071-bae6-f8c64c6263ca","Type":"ContainerStarted","Data":"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"}
Sep 10 22:39:14.812778 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.812297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" event={"ID":"5eb3d112-1b6e-4071-bae6-f8c64c6263ca","Type":"ContainerStarted","Data":"663c2357e921d6930f5d3fd8b2362e773265e9f0e27b2646966a993d51a0c06e"}
Sep 10 22:39:14.827674 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.827626    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" podStartSLOduration=1.827611055 podStartE2EDuration="1.827611055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:39:14.827226063 +0000 UTC m=+1261.411303103" watchObservedRunningTime="2026-09-10 22:39:14.827611055 +0000 UTC m=+1261.411688094"
Sep 10 22:39:14.874750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:14.874720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:20.914872 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:20.914827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:20.987857 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:20.987825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:21.569207 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:21.569173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:22.795726 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:22.795685    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" podUID="240799a8-297c-480d-b021-aa3cf8bb22c4" containerName="main" containerID="cri-o://d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201" gracePeriod=45
Sep 10 22:39:23.035414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.035391    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:39:23.130950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.130857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.130950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.130900    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dgkj\" (UniqueName: \"kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.131189 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.130958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.131189 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.130974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.131189 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131008    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.131189 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131043    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache\") pod \"240799a8-297c-480d-b021-aa3cf8bb22c4\" (UID: \"240799a8-297c-480d-b021-aa3cf8bb22c4\") "
Sep 10 22:39:23.131403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131189    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.131403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home" (OuterVolumeSpecName: "home") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.131403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131337    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.131403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131351    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.131403 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.131350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.133217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.133197    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm" (OuterVolumeSpecName: "dshm") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.133585 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.133566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:39:23.133636 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.133580    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj" (OuterVolumeSpecName: "kube-api-access-2dgkj") pod "240799a8-297c-480d-b021-aa3cf8bb22c4" (UID: "240799a8-297c-480d-b021-aa3cf8bb22c4"). InnerVolumeSpecName "kube-api-access-2dgkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:39:23.145333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.145282    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerName="main" containerID="cri-o://8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0" gracePeriod=45
Sep 10 22:39:23.149194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.149163    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": EOF"
Sep 10 22:39:23.232075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.232038    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240799a8-297c-480d-b021-aa3cf8bb22c4-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.232075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.232070    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.232075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.232080    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dgkj\" (UniqueName: \"kubernetes.io/projected/240799a8-297c-480d-b021-aa3cf8bb22c4-kube-api-access-2dgkj\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.232301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.232088    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/240799a8-297c-480d-b021-aa3cf8bb22c4-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.383369 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.383312    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:39:23.433967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.433937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.433989    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4fzc\" (UniqueName: \"kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434031    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434076    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434136    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache\") pod \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\" (UID: \"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4\") "
Sep 10 22:39:23.434411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434282    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.434450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434413    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.434450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home" (OuterVolumeSpecName: "home") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.434450 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.434432    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.436310 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.436288    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc" (OuterVolumeSpecName: "kube-api-access-w4fzc") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "kube-api-access-w4fzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:39:23.436387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.436291    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:39:23.436387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.436309    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm" (OuterVolumeSpecName: "dshm") pod "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" (UID: "69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:39:23.535669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.535632    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.535669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.535662    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.535669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.535676    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4fzc\" (UniqueName: \"kubernetes.io/projected/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-kube-api-access-w4fzc\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.535903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.535689    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.535903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.535701    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:39:23.857194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.857162    2559 generic.go:356] "Generic (PLEG): container finished" podID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerID="8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0" exitCode=0
Sep 10 22:39:23.857658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.857204    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"
Sep 10 22:39:23.857658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.857248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" event={"ID":"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4","Type":"ContainerDied","Data":"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"}
Sep 10 22:39:23.857658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.857294    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2" event={"ID":"69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4","Type":"ContainerDied","Data":"741ba8a4a17fe0b3467832f555f6470880c58a39283d255d2c07cc54c82483b4"}
Sep 10 22:39:23.857658 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.857317    2559 scope.go:117] "RemoveContainer" containerID="8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"
Sep 10 22:39:23.858836 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.858818    2559 generic.go:356] "Generic (PLEG): container finished" podID="240799a8-297c-480d-b021-aa3cf8bb22c4" containerID="d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201" exitCode=0
Sep 10 22:39:23.858907 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.858868    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"
Sep 10 22:39:23.858907 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.858874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" event={"ID":"240799a8-297c-480d-b021-aa3cf8bb22c4","Type":"ContainerDied","Data":"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"}
Sep 10 22:39:23.858995 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.858905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw" event={"ID":"240799a8-297c-480d-b021-aa3cf8bb22c4","Type":"ContainerDied","Data":"b3d2aac5a5ed8c5a198659fef47ac2e330bd9540848ecf93ebb0eba036e53ea4"}
Sep 10 22:39:23.868411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.867014    2559 scope.go:117] "RemoveContainer" containerID="8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"
Sep 10 22:39:23.868554 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:39:23.868507    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0\": container with ID starting with 8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0 not found: ID does not exist" containerID="8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"
Sep 10 22:39:23.868622 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.868546    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0"} err="failed to get container status \"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0\": rpc error: code = NotFound desc = could not find container \"8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0\": container with ID starting with 8f208d9cb509883d20045c9bd46989cb2ca90d5025fd13d8838d174979a194f0 not found: ID does not exist"
Sep 10 22:39:23.868622 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.868570    2559 scope.go:117] "RemoveContainer" containerID="d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"
Sep 10 22:39:23.879610 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.879587    2559 scope.go:117] "RemoveContainer" containerID="d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"
Sep 10 22:39:23.879939 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:39:23.879918    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201\": container with ID starting with d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201 not found: ID does not exist" containerID="d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"
Sep 10 22:39:23.880003 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.879946    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201"} err="failed to get container status \"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201\": rpc error: code = NotFound desc = could not find container \"d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201\": container with ID starting with d1c210fa845766e095ba36f45e99cafd02a6806dc63647cb62dec7de8f5d8201 not found: ID does not exist"
Sep 10 22:39:23.891659 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.891638    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:39:23.892349 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.892329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/auth-test-model-33b4cf-kserve-86b8968c67-fc8j2"]
Sep 10 22:39:23.903696 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.903675    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:39:23.907628 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.907608    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/auth-test-model-58cd39-kserve-5cd9df99f5-pkhpw"]
Sep 10 22:39:23.969993 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.969958    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:23.970229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.970212    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:23.982473 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:23.982446    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:24.876926 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:24.876895    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:39:25.891843 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:25.891813    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240799a8-297c-480d-b021-aa3cf8bb22c4" path="/var/lib/kubelet/pods/240799a8-297c-480d-b021-aa3cf8bb22c4/volumes"
Sep 10 22:39:25.892217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:25.892188    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" path="/var/lib/kubelet/pods/69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4/volumes"
Sep 10 22:39:27.288402 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:27.288367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:27.347685 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:27.347657    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:39:27.355655 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:27.355623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:27.451639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:27.451600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:27.552069 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:27.551977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:37.973592 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:37.973549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:38.184741 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:38.184704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:58.125020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:58.124984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:39:59.120446 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:39:59.120409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:00.550865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.550823    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:40:00.551361 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551340    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240799a8-297c-480d-b021-aa3cf8bb22c4" containerName="main"
Sep 10 22:40:00.551444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551365    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="240799a8-297c-480d-b021-aa3cf8bb22c4" containerName="main"
Sep 10 22:40:00.551444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551392    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerName="main"
Sep 10 22:40:00.551444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551401    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerName="main"
Sep 10 22:40:00.551613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551533    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="69cc44dc-3370-4d69-ad2c-7ad77cf3a7a4" containerName="main"
Sep 10 22:40:00.551613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.551550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="240799a8-297c-480d-b021-aa3cf8bb22c4" containerName="main"
Sep 10 22:40:00.554762 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.554741    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.558055 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.558035    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"sub-test-model-33b4cf-kserve-self-signed-certs\""
Sep 10 22:40:00.558164 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.558038    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"kube-root-ca.crt\""
Sep 10 22:40:00.558230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.558044    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"openshift-service-ca.crt\""
Sep 10 22:40:00.558285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.558045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"default-dockercfg-8fjss\""
Sep 10 22:40:00.564585 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.564562    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:40:00.591385 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.591363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:00.652711 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgpp\" (UniqueName: \"kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.652808 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.652808 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.652886 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.652886 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.652951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.652905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753409 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753589 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgpp\" (UniqueName: \"kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753589 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753857    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.753881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.754004 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.753921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.755686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.755659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.755956 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.755941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.762282 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.762261    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgpp\" (UniqueName: \"kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp\") pod \"sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:00.867227 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:00.867162    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:01.146577 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:01.146551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:40:01.148667 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:40:01.148642    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92764d7f_3492_4cfc_8645_a1e20a315cd7.slice/crio-c5641d7fb6bbe633814199df561c87a76c8167786ea13ad8b3efc54e1a0fc4fc WatchSource:0}: Error finding container c5641d7fb6bbe633814199df561c87a76c8167786ea13ad8b3efc54e1a0fc4fc: Status 404 returned error can't find the container with id c5641d7fb6bbe633814199df561c87a76c8167786ea13ad8b3efc54e1a0fc4fc
Sep 10 22:40:02.041567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:02.041532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" event={"ID":"92764d7f-3492-4cfc-8645-a1e20a315cd7","Type":"ContainerStarted","Data":"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"}
Sep 10 22:40:02.041955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:02.041575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" event={"ID":"92764d7f-3492-4cfc-8645-a1e20a315cd7","Type":"ContainerStarted","Data":"c5641d7fb6bbe633814199df561c87a76c8167786ea13ad8b3efc54e1a0fc4fc"}
Sep 10 22:40:02.058516 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:02.058459    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" podStartSLOduration=2.0584442530000002 podStartE2EDuration="2.058444253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:02.05743269 +0000 UTC m=+1308.641509732" watchObservedRunningTime="2026-09-10 22:40:02.058444253 +0000 UTC m=+1308.642521338"
Sep 10 22:40:04.979393 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:04.979345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:05.059540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:05.059513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:05.260236 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:05.260141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:40:05.332098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:05.332066    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:05.666188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:05.666089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:06.002505 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:06.002466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:08.526121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:08.526088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:08.624848 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:08.624804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:09.823347 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:09.823311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:09.884670 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:09.884635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:10.107794 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.107701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:10.334923 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.334888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:10.427939 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.427852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:10.867475 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.867440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:10.867861 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.867529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:10.880122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:10.880101    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:11.095624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:11.095594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:40:14.034036 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:14.034001    2559 scope.go:117] "RemoveContainer" containerID="44da7a7297e2315e794f03f2a940b22e19bc529e9e25fdcfc4d841072c068a60"
Sep 10 22:40:18.646954 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:18.646916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:40:33.501636 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:33.501593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:34.134605 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:34.134566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:34.475156 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:34.475116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:34.808936 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:34.808838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:37.781834 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:37.781739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:37.879808 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:37.879777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.129224 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.129180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.203624 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.203588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.484826 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.484793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.691100 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.691060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.785769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.785669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:39.832673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.832636    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:40:39.837654 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.837632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:39.841268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.841235    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ecb38e\""
Sep 10 22:40:39.841268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.841235    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ecb38e-dockercfg-895xm\""
Sep 10 22:40:39.849634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.849608    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:40:39.896414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.896378    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:40:39.899946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.899928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:39.921051 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:39.921018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:40:40.015246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.015206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.015446 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.015252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5tp\" (UniqueName: \"kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.015446 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.015403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.015623 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.015532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7scv\" (UniqueName: \"kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.116798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.116705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7scv\" (UniqueName: \"kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.116798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.116758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.116798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.116784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5tp\" (UniqueName: \"kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.117029 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.116835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.117573 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.117551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.117621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.117566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.126414 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.126381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7scv\" (UniqueName: \"kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv\") pod \"payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.127305 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.127280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5tp\" (UniqueName: \"kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp\") pod \"payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") " pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.149295 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.149255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:40.209999 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.209932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:40.435479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.435451    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:40:40.437326 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:40:40.437300    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111ef851_dc79_4baa_8c6f_fdf1ef017154.slice/crio-4bfd392be3edc37fe9cd021a1ed73934c00ed635bb848126faab2de13cb7dfb3 WatchSource:0}: Error finding container 4bfd392be3edc37fe9cd021a1ed73934c00ed635bb848126faab2de13cb7dfb3: Status 404 returned error can't find the container with id 4bfd392be3edc37fe9cd021a1ed73934c00ed635bb848126faab2de13cb7dfb3
Sep 10 22:40:40.495866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:40.495838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:40:40.497372 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:40:40.497347    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4073d996_99fc_4d5e_bf27_3c52efe15b94.slice/crio-77d866f29d98097b1209c0698d7d375cdd96431a6f946c0e6ec00ebef9e05929 WatchSource:0}: Error finding container 77d866f29d98097b1209c0698d7d375cdd96431a6f946c0e6ec00ebef9e05929: Status 404 returned error can't find the container with id 77d866f29d98097b1209c0698d7d375cdd96431a6f946c0e6ec00ebef9e05929
Sep 10 22:40:41.244340 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.244293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" event={"ID":"4073d996-99fc-4d5e-bf27-3c52efe15b94","Type":"ContainerStarted","Data":"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"}
Sep 10 22:40:41.244866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.244368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" event={"ID":"4073d996-99fc-4d5e-bf27-3c52efe15b94","Type":"ContainerStarted","Data":"77d866f29d98097b1209c0698d7d375cdd96431a6f946c0e6ec00ebef9e05929"}
Sep 10 22:40:41.244866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.244479    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:40:41.246108 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.246081    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" event={"ID":"111ef851-dc79-4baa-8c6f-fdf1ef017154","Type":"ContainerStarted","Data":"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"}
Sep 10 22:40:41.246230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.246124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" event={"ID":"111ef851-dc79-4baa-8c6f-fdf1ef017154","Type":"ContainerStarted","Data":"4bfd392be3edc37fe9cd021a1ed73934c00ed635bb848126faab2de13cb7dfb3"}
Sep 10 22:40:41.246230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.246153    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:41.268231 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.268167    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" podStartSLOduration=2.268149629 podStartE2EDuration="2.268149629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:41.264756385 +0000 UTC m=+1347.848833429" watchObservedRunningTime="2026-09-10 22:40:41.268149629 +0000 UTC m=+1347.852226669"
Sep 10 22:40:41.289973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:41.289909    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" podStartSLOduration=2.289889392 podStartE2EDuration="2.289889392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:41.289274931 +0000 UTC m=+1347.873351972" watchObservedRunningTime="2026-09-10 22:40:41.289889392 +0000 UTC m=+1347.873966434"
Sep 10 22:40:43.383098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:43.383048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:40:43.449976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:43.449948    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:40:52.253580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:52.253541    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:40:52.253950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:40:52.253628    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:41:01.653865 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:01.653819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:02.759501 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:02.759462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:03.257970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.257935    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7577-1846ae"]
Sep 10 22:41:03.261481 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.261465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:03.264832 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.264808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ks5gc\""
Sep 10 22:41:03.267941 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.267917    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7577-1846ae"]
Sep 10 22:41:03.328932 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.328892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbm7\" (UniqueName: \"kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7\") pod \"test-curl-7577-1846ae\" (UID: \"4527aed8-981e-4cf0-926a-b0e7e7fb9163\") " pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:03.430411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.430367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbm7\" (UniqueName: \"kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7\") pod \"test-curl-7577-1846ae\" (UID: \"4527aed8-981e-4cf0-926a-b0e7e7fb9163\") " pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:03.439330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.439292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbm7\" (UniqueName: \"kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7\") pod \"test-curl-7577-1846ae\" (UID: \"4527aed8-981e-4cf0-926a-b0e7e7fb9163\") " pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:03.572841 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.572747    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:03.845983 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.845950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7577-1846ae"]
Sep 10 22:41:03.847379 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:41:03.847350    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4527aed8_981e_4cf0_926a_b0e7e7fb9163.slice/crio-e8fffbf8642a8a984a33a044315098332c46e0a9624b917efdff3362d02a3f26 WatchSource:0}: Error finding container e8fffbf8642a8a984a33a044315098332c46e0a9624b917efdff3362d02a3f26: Status 404 returned error can't find the container with id e8fffbf8642a8a984a33a044315098332c46e0a9624b917efdff3362d02a3f26
Sep 10 22:41:03.849263 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:03.849247    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:41:04.365749 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:04.365714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7577-1846ae" event={"ID":"4527aed8-981e-4cf0-926a-b0e7e7fb9163","Type":"ContainerStarted","Data":"e8fffbf8642a8a984a33a044315098332c46e0a9624b917efdff3362d02a3f26"}
Sep 10 22:41:05.492713 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.492675    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"]
Sep 10 22:41:05.497237 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.497215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:05.500199 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.500169    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:41:05.500362 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.500284    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:41:05.506328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.506303    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"]
Sep 10 22:41:05.551816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.551767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v\" (UID: \"a1a253e6-3d4c-42cb-ba95-182a923ea05f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:05.652812 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.652774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v\" (UID: \"a1a253e6-3d4c-42cb-ba95-182a923ea05f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:05.653408 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.653387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v\" (UID: \"a1a253e6-3d4c-42cb-ba95-182a923ea05f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:05.686767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.686727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:05.810392 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:05.810298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:06.088640 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:06.088604    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"]
Sep 10 22:41:06.090837 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:41:06.090806    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a253e6_3d4c_42cb_ba95_182a923ea05f.slice/crio-8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df WatchSource:0}: Error finding container 8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df: Status 404 returned error can't find the container with id 8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df
Sep 10 22:41:06.377508 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:06.377454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v" event={"ID":"a1a253e6-3d4c-42cb-ba95-182a923ea05f","Type":"ContainerStarted","Data":"9c1f09aef7a621203880f0ad5e7d4066a622ffdf461250a26960fa19e92e3b5d"}
Sep 10 22:41:06.377719 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:06.377543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v" event={"ID":"a1a253e6-3d4c-42cb-ba95-182a923ea05f","Type":"ContainerStarted","Data":"8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df"}
Sep 10 22:41:06.403820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:06.403759    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v" podStartSLOduration=1.403743159 podStartE2EDuration="1.403743159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:06.402369635 +0000 UTC m=+1372.986446676" watchObservedRunningTime="2026-09-10 22:41:06.403743159 +0000 UTC m=+1372.987820199"
Sep 10 22:41:06.473130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:06.473082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:41:07.386791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:07.386745    2559 generic.go:356] "Generic (PLEG): container finished" podID="a1a253e6-3d4c-42cb-ba95-182a923ea05f" containerID="9c1f09aef7a621203880f0ad5e7d4066a622ffdf461250a26960fa19e92e3b5d" exitCode=0
Sep 10 22:41:07.387230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:07.386829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v" event={"ID":"a1a253e6-3d4c-42cb-ba95-182a923ea05f","Type":"ContainerDied","Data":"9c1f09aef7a621203880f0ad5e7d4066a622ffdf461250a26960fa19e92e3b5d"}
Sep 10 22:41:08.539544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:08.539511    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:08.578704 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:08.578671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca\") pod \"a1a253e6-3d4c-42cb-ba95-182a923ea05f\" (UID: \"a1a253e6-3d4c-42cb-ba95-182a923ea05f\") "
Sep 10 22:41:08.579043 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:08.579020    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1a253e6-3d4c-42cb-ba95-182a923ea05f" (UID: "a1a253e6-3d4c-42cb-ba95-182a923ea05f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:08.680296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:08.680205    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a253e6-3d4c-42cb-ba95-182a923ea05f-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:09.398712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:09.398672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v" event={"ID":"a1a253e6-3d4c-42cb-ba95-182a923ea05f","Type":"ContainerDied","Data":"8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df"}
Sep 10 22:41:09.398712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:09.398697    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"
Sep 10 22:41:09.399019 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:09.398727    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ae7d2e91494095d42c201685507dbf0c4c0d57150322ecbabfd850c2cf0e1df"
Sep 10 22:41:09.457985 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:09.457945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:12.322826 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:12.322788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:12.417367 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:12.417322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7577-1846ae" event={"ID":"4527aed8-981e-4cf0-926a-b0e7e7fb9163","Type":"ContainerStarted","Data":"abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917"}
Sep 10 22:41:12.437863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:12.437807    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7577-1846ae" podStartSLOduration=0.956176684 podStartE2EDuration="9.437788271s" totalImagesPullingTime="8.481611587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:12.435542686 +0000 UTC m=+1379.019619728" watchObservedRunningTime="2026-09-10 22:41:12.437788271 +0000 UTC m=+1379.021865376"
Sep 10 22:41:13.045502 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:13.045446    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7577-1846ae"]
Sep 10 22:41:13.050706 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:13.050665    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7577-1846ae"]
Sep 10 22:41:13.145950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:13.145912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:13.423081 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:13.422997    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7577-1846ae" container="test-curl-7577-1846ae"
Sep 10 22:41:14.062092 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:14.062055    2559 scope.go:117] "RemoveContainer" containerID="132209aeed5543e27ef3778b6c6bb41563bc23aa7b52117ebce564bb5722bd87"
Sep 10 22:41:14.070546 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:14.070518    2559 scope.go:117] "RemoveContainer" containerID="393da0b7f603bae5e37d9cc3c2baf80b2a3a6a87374318b3c5dba041d0c87bc4"
Sep 10 22:41:14.428355 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:14.428259    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7577-1846ae" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" containerName="test-curl-7577-1846ae" containerID="cri-o://abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917" gracePeriod=2
Sep 10 22:41:15.672578 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:15.672543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:16.601769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.601736    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:16.757769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.757732    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:41:16.762327 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.762300    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzbm7\" (UniqueName: \"kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7\") pod \"4527aed8-981e-4cf0-926a-b0e7e7fb9163\" (UID: \"4527aed8-981e-4cf0-926a-b0e7e7fb9163\") "
Sep 10 22:41:16.764338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.764314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7" (OuterVolumeSpecName: "kube-api-access-lzbm7") pod "4527aed8-981e-4cf0-926a-b0e7e7fb9163" (UID: "4527aed8-981e-4cf0-926a-b0e7e7fb9163"). InnerVolumeSpecName "kube-api-access-lzbm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:16.775812 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.775768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:16.863651 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:16.863608    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzbm7\" (UniqueName: \"kubernetes.io/projected/4527aed8-981e-4cf0-926a-b0e7e7fb9163-kube-api-access-lzbm7\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:17.445922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.445887    2559 generic.go:356] "Generic (PLEG): container finished" podID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" containerID="abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917" exitCode=137
Sep 10 22:41:17.446129 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.445926    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:17.446129 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.445994    2559 scope.go:117] "RemoveContainer" containerID="abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917"
Sep 10 22:41:17.454935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.454915    2559 scope.go:117] "RemoveContainer" containerID="abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917"
Sep 10 22:41:17.455248 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:17.455223    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917\": container with ID starting with abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917 not found: ID does not exist" containerID="abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917"
Sep 10 22:41:17.455288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.455261    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917"} err="failed to get container status \"abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917\": rpc error: code = NotFound desc = could not find container \"abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917\": container with ID starting with abc6bf90c5bc50f0f3ac23205b9c27208d836b169ae88dc3f8bc0aaba21ef917 not found: ID does not exist"
Sep 10 22:41:17.456764 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:17.456739    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-1846ae\" is forbidden: User \"system:node:ip-10-0-132-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-64.ec2.internal' and this object" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:17.824156 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.824120    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:41:17.826313 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:17.826276    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-1846ae\" is forbidden: User \"system:node:ip-10-0-132-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-64.ec2.internal' and this object" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" pod="opendatahub/test-curl-7577-1846ae"
Sep 10 22:41:17.844831 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.844790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:17.892151 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:17.892118    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" path="/var/lib/kubelet/pods/4527aed8-981e-4cf0-926a-b0e7e7fb9163/volumes"
Sep 10 22:41:21.325337 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.325306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.413636 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.413594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.491426 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.491376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.567047 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.567010    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"]
Sep 10 22:41:21.570262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.570215    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.571303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.571276    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-03e78e-m2q6v"]
Sep 10 22:41:21.655085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.654999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:21.896542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.896508    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a253e6-3d4c-42cb-ba95-182a923ea05f" path="/var/lib/kubelet/pods/a1a253e6-3d4c-42cb-ba95-182a923ea05f/volumes"
Sep 10 22:41:21.910112 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:21.910027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:23.847905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:23.847864    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:41:27.722765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:27.722728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:27.822913 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:27.822865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:27.988200 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:27.988105    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:28.308568 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308466    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"]
Sep 10 22:41:28.308866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308852    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a253e6-3d4c-42cb-ba95-182a923ea05f" containerName="revoke-keys"
Sep 10 22:41:28.308866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308867    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a253e6-3d4c-42cb-ba95-182a923ea05f" containerName="revoke-keys"
Sep 10 22:41:28.308980 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308879    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" containerName="test-curl-7577-1846ae"
Sep 10 22:41:28.308980 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308885    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" containerName="test-curl-7577-1846ae"
Sep 10 22:41:28.309071 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308983    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4527aed8-981e-4cf0-926a-b0e7e7fb9163" containerName="test-curl-7577-1846ae"
Sep 10 22:41:28.309071 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.308999    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a253e6-3d4c-42cb-ba95-182a923ea05f" containerName="revoke-keys"
Sep 10 22:41:28.313565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.313546    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:28.316098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.316077    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:41:28.316232 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.316082    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:41:28.321420 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.321077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"]
Sep 10 22:41:28.478387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.478344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt\" (UID: \"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:28.521672 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.521620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:28.579234 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.579141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt\" (UID: \"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:28.579817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.579790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt\" (UID: \"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:28.624850 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.624813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:28.904479 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:28.904443    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"]
Sep 10 22:41:28.906604 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:41:28.906570    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0d9d91_a5a8_4d4c_81f8_84c073f9b35f.slice/crio-735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5 WatchSource:0}: Error finding container 735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5: Status 404 returned error can't find the container with id 735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5
Sep 10 22:41:29.510124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:29.510088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt" event={"ID":"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f","Type":"ContainerStarted","Data":"efc40f8090f4e44feccae88a3f10add52383f46e846ba922b47242f703522cb0"}
Sep 10 22:41:29.510314 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:29.510149    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt" event={"ID":"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f","Type":"ContainerStarted","Data":"735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5"}
Sep 10 22:41:29.525697 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:29.525637    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt" podStartSLOduration=1.52561972 podStartE2EDuration="1.52561972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:29.52408026 +0000 UTC m=+1396.108157301" watchObservedRunningTime="2026-09-10 22:41:29.52561972 +0000 UTC m=+1396.109696759"
Sep 10 22:41:30.517217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:30.517183    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" containerID="efc40f8090f4e44feccae88a3f10add52383f46e846ba922b47242f703522cb0" exitCode=0
Sep 10 22:41:30.517663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:30.517278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt" event={"ID":"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f","Type":"ContainerDied","Data":"efc40f8090f4e44feccae88a3f10add52383f46e846ba922b47242f703522cb0"}
Sep 10 22:41:31.584963 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.584925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:31.653332 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.653283    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:31.705056 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.705023    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca\") pod \"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f\" (UID: \"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f\") "
Sep 10 22:41:31.705348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.705326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" (UID: "9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:31.778206 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.778106    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" podUID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" containerName="main" containerID="cri-o://6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79" gracePeriod=45
Sep 10 22:41:31.806168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:31.806130    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.036551 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.036461    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:41:32.109245 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109329    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109364    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvqn2\" (UniqueName: \"kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2\") pod \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\" (UID: \"5eb3d112-1b6e-4071-bae6-f8c64c6263ca\") "
Sep 10 22:41:32.109760 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:32.109760 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109654    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home" (OuterVolumeSpecName: "home") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:32.109760 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:32.109904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109839    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.109904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109854    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.109904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.109863    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.111619 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.111558    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:41:32.111619 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.111578    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm" (OuterVolumeSpecName: "dshm") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:32.111721 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.111620    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2" (OuterVolumeSpecName: "kube-api-access-xvqn2") pod "5eb3d112-1b6e-4071-bae6-f8c64c6263ca" (UID: "5eb3d112-1b6e-4071-bae6-f8c64c6263ca"). InnerVolumeSpecName "kube-api-access-xvqn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:32.210394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.210338    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.210394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.210382    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.210394 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.210396    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvqn2\" (UniqueName: \"kubernetes.io/projected/5eb3d112-1b6e-4071-bae6-f8c64c6263ca-kube-api-access-xvqn2\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:32.531121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.531087    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"
Sep 10 22:41:32.531318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.531123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt" event={"ID":"9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f","Type":"ContainerDied","Data":"735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5"}
Sep 10 22:41:32.531318 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.531205    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="735feddbd020727e13bde705ff5f930228f7b6513065f7a362d6cc88969e95e5"
Sep 10 22:41:32.532463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.532442    2559 generic.go:356] "Generic (PLEG): container finished" podID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" containerID="6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79" exitCode=0
Sep 10 22:41:32.532590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.532473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" event={"ID":"5eb3d112-1b6e-4071-bae6-f8c64c6263ca","Type":"ContainerDied","Data":"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"}
Sep 10 22:41:32.532590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.532478    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"
Sep 10 22:41:32.532590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.532527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm" event={"ID":"5eb3d112-1b6e-4071-bae6-f8c64c6263ca","Type":"ContainerDied","Data":"663c2357e921d6930f5d3fd8b2362e773265e9f0e27b2646966a993d51a0c06e"}
Sep 10 22:41:32.532590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.532548    2559 scope.go:117] "RemoveContainer" containerID="6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"
Sep 10 22:41:32.541642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.541622    2559 scope.go:117] "RemoveContainer" containerID="6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"
Sep 10 22:41:32.541929 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:32.541911    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79\": container with ID starting with 6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79 not found: ID does not exist" containerID="6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"
Sep 10 22:41:32.541977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.541937    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79"} err="failed to get container status \"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79\": rpc error: code = NotFound desc = could not find container \"6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79\": container with ID starting with 6a1d6b9c9fcab293a8f0bab85c57bcc375ebc5067d551462bfb0448d0380fd79 not found: ID does not exist"
Sep 10 22:41:32.555141 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.555113    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:41:32.560929 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.560904    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/sub-test-model-58cd39-kserve-77989897c9-kpckm"]
Sep 10 22:41:32.843540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:32.843440    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" podUID="92764d7f-3492-4cfc-8645-a1e20a315cd7" containerName="main" containerID="cri-o://e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128" gracePeriod=45
Sep 10 22:41:33.091218 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.091192    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:41:33.118412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118412 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118378    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118446    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pgpp\" (UniqueName: \"kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118639 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache\") pod \"92764d7f-3492-4cfc-8645-a1e20a315cd7\" (UID: \"92764d7f-3492-4cfc-8645-a1e20a315cd7\") "
Sep 10 22:41:33.118866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118653    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:33.118866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118758    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home" (OuterVolumeSpecName: "home") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:33.118866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache" (OuterVolumeSpecName: "model-cache") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:33.118973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118930    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.118973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118948    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.118973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.118958    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.120576 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.120550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm" (OuterVolumeSpecName: "dshm") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:41:33.120759 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.120737    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp" (OuterVolumeSpecName: "kube-api-access-7pgpp") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "kube-api-access-7pgpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:33.121001 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.120970    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92764d7f-3492-4cfc-8645-a1e20a315cd7" (UID: "92764d7f-3492-4cfc-8645-a1e20a315cd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:41:33.219723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.219685    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92764d7f-3492-4cfc-8645-a1e20a315cd7-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.219723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.219717    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92764d7f-3492-4cfc-8645-a1e20a315cd7-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.219723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.219727    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pgpp\" (UniqueName: \"kubernetes.io/projected/92764d7f-3492-4cfc-8645-a1e20a315cd7-kube-api-access-7pgpp\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:33.539471 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.539434    2559 generic.go:356] "Generic (PLEG): container finished" podID="92764d7f-3492-4cfc-8645-a1e20a315cd7" containerID="e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128" exitCode=0
Sep 10 22:41:33.539686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.539482    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"
Sep 10 22:41:33.539686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.539521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" event={"ID":"92764d7f-3492-4cfc-8645-a1e20a315cd7","Type":"ContainerDied","Data":"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"}
Sep 10 22:41:33.539686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.539571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4" event={"ID":"92764d7f-3492-4cfc-8645-a1e20a315cd7","Type":"ContainerDied","Data":"c5641d7fb6bbe633814199df561c87a76c8167786ea13ad8b3efc54e1a0fc4fc"}
Sep 10 22:41:33.539686 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.539594    2559 scope.go:117] "RemoveContainer" containerID="e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"
Sep 10 22:41:33.548580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.548561    2559 scope.go:117] "RemoveContainer" containerID="e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"
Sep 10 22:41:33.548911 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:33.548880    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128\": container with ID starting with e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128 not found: ID does not exist" containerID="e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"
Sep 10 22:41:33.548990 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.548923    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128"} err="failed to get container status \"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128\": rpc error: code = NotFound desc = could not find container \"e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128\": container with ID starting with e3a2f74edf807f01d806d47fe550c4552417655536f244467d7931c64c60b128 not found: ID does not exist"
Sep 10 22:41:33.561975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.561939    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:41:33.565533 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.565478    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/sub-test-model-33b4cf-kserve-bb6d7f889-6t6m4"]
Sep 10 22:41:33.892346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.892265    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" path="/var/lib/kubelet/pods/5eb3d112-1b6e-4071-bae6-f8c64c6263ca/volumes"
Sep 10 22:41:33.892735 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:33.892681    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92764d7f-3492-4cfc-8645-a1e20a315cd7" path="/var/lib/kubelet/pods/92764d7f-3492-4cfc-8645-a1e20a315cd7/volumes"
Sep 10 22:41:34.754765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:34.754734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:34.900544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:34.900508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:37.794794 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:37.794755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:39.752580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:39.752530    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:41:43.504014 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.503971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:43.533881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.533844    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:41:43.534140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.534113    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" podUID="111ef851-dc79-4baa-8c6f-fdf1ef017154" containerName="payload-processing" containerID="cri-o://78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a" gracePeriod=30
Sep 10 22:41:43.544533 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.544475    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:41:43.545816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.544835    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" podUID="4073d996-99fc-4d5e-bf27-3c52efe15b94" containerName="payload-pre-processing" containerID="cri-o://c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4" gracePeriod=30
Sep 10 22:41:43.603168 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.603135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:43.703856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.703808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:43.735998 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.735953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"]
Sep 10 22:41:43.738602 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.738577    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ecb38e-bpbzt"]
Sep 10 22:41:43.804944 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.804911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:43.821422 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.821388    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:41:43.824514 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.824469    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:41:43.891292 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.891258    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" path="/var/lib/kubelet/pods/9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f/volumes"
Sep 10 22:41:43.925577 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.925544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume\") pod \"111ef851-dc79-4baa-8c6f-fdf1ef017154\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") "
Sep 10 22:41:43.925766 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.925668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume\") pod \"4073d996-99fc-4d5e-bf27-3c52efe15b94\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") "
Sep 10 22:41:43.925766 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.925690    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l5tp\" (UniqueName: \"kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp\") pod \"111ef851-dc79-4baa-8c6f-fdf1ef017154\" (UID: \"111ef851-dc79-4baa-8c6f-fdf1ef017154\") "
Sep 10 22:41:43.925766 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.925719    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7scv\" (UniqueName: \"kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv\") pod \"4073d996-99fc-4d5e-bf27-3c52efe15b94\" (UID: \"4073d996-99fc-4d5e-bf27-3c52efe15b94\") "
Sep 10 22:41:43.926074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.926041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "111ef851-dc79-4baa-8c6f-fdf1ef017154" (UID: "111ef851-dc79-4baa-8c6f-fdf1ef017154"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:43.926156 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.926096    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4073d996-99fc-4d5e-bf27-3c52efe15b94" (UID: "4073d996-99fc-4d5e-bf27-3c52efe15b94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:43.927839 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.927814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv" (OuterVolumeSpecName: "kube-api-access-b7scv") pod "4073d996-99fc-4d5e-bf27-3c52efe15b94" (UID: "4073d996-99fc-4d5e-bf27-3c52efe15b94"). InnerVolumeSpecName "kube-api-access-b7scv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:43.927970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:43.927903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp" (OuterVolumeSpecName: "kube-api-access-9l5tp") pod "111ef851-dc79-4baa-8c6f-fdf1ef017154" (UID: "111ef851-dc79-4baa-8c6f-fdf1ef017154"). InnerVolumeSpecName "kube-api-access-9l5tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:44.027262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.027203    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7scv\" (UniqueName: \"kubernetes.io/projected/4073d996-99fc-4d5e-bf27-3c52efe15b94-kube-api-access-b7scv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:44.027262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.027258    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111ef851-dc79-4baa-8c6f-fdf1ef017154-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:44.027262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.027269    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4073d996-99fc-4d5e-bf27-3c52efe15b94-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:44.027262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.027278    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l5tp\" (UniqueName: \"kubernetes.io/projected/111ef851-dc79-4baa-8c6f-fdf1ef017154-kube-api-access-9l5tp\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:44.087228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.087133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:44.603208 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.603169    2559 generic.go:356] "Generic (PLEG): container finished" podID="4073d996-99fc-4d5e-bf27-3c52efe15b94" containerID="c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4" exitCode=0
Sep 10 22:41:44.603707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.603219    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"
Sep 10 22:41:44.603707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.603258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" event={"ID":"4073d996-99fc-4d5e-bf27-3c52efe15b94","Type":"ContainerDied","Data":"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"}
Sep 10 22:41:44.603707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.603313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k" event={"ID":"4073d996-99fc-4d5e-bf27-3c52efe15b94","Type":"ContainerDied","Data":"77d866f29d98097b1209c0698d7d375cdd96431a6f946c0e6ec00ebef9e05929"}
Sep 10 22:41:44.603707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.603339    2559 scope.go:117] "RemoveContainer" containerID="c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"
Sep 10 22:41:44.604790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.604562    2559 generic.go:356] "Generic (PLEG): container finished" podID="111ef851-dc79-4baa-8c6f-fdf1ef017154" containerID="78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a" exitCode=0
Sep 10 22:41:44.604790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.604610    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"
Sep 10 22:41:44.604790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.604614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" event={"ID":"111ef851-dc79-4baa-8c6f-fdf1ef017154","Type":"ContainerDied","Data":"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"}
Sep 10 22:41:44.604790 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.604754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh" event={"ID":"111ef851-dc79-4baa-8c6f-fdf1ef017154","Type":"ContainerDied","Data":"4bfd392be3edc37fe9cd021a1ed73934c00ed635bb848126faab2de13cb7dfb3"}
Sep 10 22:41:44.612045 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.612025    2559 scope.go:117] "RemoveContainer" containerID="c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"
Sep 10 22:41:44.612322 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:44.612302    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4\": container with ID starting with c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4 not found: ID does not exist" containerID="c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"
Sep 10 22:41:44.612380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.612331    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4"} err="failed to get container status \"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4\": rpc error: code = NotFound desc = could not find container \"c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4\": container with ID starting with c7f664f336e57496adff2c4cd5557cc248c8afcf7e9690a6591a6dfd720b09a4 not found: ID does not exist"
Sep 10 22:41:44.612380 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.612347    2559 scope.go:117] "RemoveContainer" containerID="78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"
Sep 10 22:41:44.621438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.621415    2559 scope.go:117] "RemoveContainer" containerID="78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"
Sep 10 22:41:44.622536 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:41:44.622485    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a\": container with ID starting with 78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a not found: ID does not exist" containerID="78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"
Sep 10 22:41:44.622655 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.622549    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a"} err="failed to get container status \"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a\": rpc error: code = NotFound desc = could not find container \"78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a\": container with ID starting with 78e5920dde3eb8783831435d97ae1e632c9fec71ce6b44c9c3ba39db2e6d393a not found: ID does not exist"
Sep 10 22:41:44.630044 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.630007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:41:44.633712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.633681    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh"]
Sep 10 22:41:44.643975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.643946    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:41:44.648336 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:44.648311    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k"]
Sep 10 22:41:45.891739 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:45.891705    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111ef851-dc79-4baa-8c6f-fdf1ef017154" path="/var/lib/kubelet/pods/111ef851-dc79-4baa-8c6f-fdf1ef017154/volumes"
Sep 10 22:41:45.892281 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:45.892261    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4073d996-99fc-4d5e-bf27-3c52efe15b94" path="/var/lib/kubelet/pods/4073d996-99fc-4d5e-bf27-3c52efe15b94/volumes"
Sep 10 22:41:48.314215 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:48.314177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:49.782688 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:49.782650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:49.883194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:49.883157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:50.029351 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.029303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:50.393365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393318    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"]
Sep 10 22:41:50.393794 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4073d996-99fc-4d5e-bf27-3c52efe15b94" containerName="payload-pre-processing"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393796    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4073d996-99fc-4d5e-bf27-3c52efe15b94" containerName="payload-pre-processing"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393811    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" containerName="main"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393818    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" containerName="main"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393827    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111ef851-dc79-4baa-8c6f-fdf1ef017154" containerName="payload-processing"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393836    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="111ef851-dc79-4baa-8c6f-fdf1ef017154" containerName="payload-processing"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393856    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" containerName="revoke-keys"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393864    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" containerName="revoke-keys"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393876    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92764d7f-3492-4cfc-8645-a1e20a315cd7" containerName="main"
Sep 10 22:41:50.393894 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393884    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="92764d7f-3492-4cfc-8645-a1e20a315cd7" containerName="main"
Sep 10 22:41:50.394315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393970    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4073d996-99fc-4d5e-bf27-3c52efe15b94" containerName="payload-pre-processing"
Sep 10 22:41:50.394315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393982    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb3d112-1b6e-4071-bae6-f8c64c6263ca" containerName="main"
Sep 10 22:41:50.394315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.393992    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="111ef851-dc79-4baa-8c6f-fdf1ef017154" containerName="payload-processing"
Sep 10 22:41:50.394315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.394003    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0d9d91-a5a8-4d4c-81f8-84c073f9b35f" containerName="revoke-keys"
Sep 10 22:41:50.394315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.394011    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="92764d7f-3492-4cfc-8645-a1e20a315cd7" containerName="main"
Sep 10 22:41:50.399153 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.399125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:50.401613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.401590    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:41:50.401737 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.401686    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:41:50.405444 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.405413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"]
Sep 10 22:41:50.497066 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.497028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7\" (UID: \"e2d50089-7106-4c01-9d8b-bbaef9e9d746\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:50.597931 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.597892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7\" (UID: \"e2d50089-7106-4c01-9d8b-bbaef9e9d746\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:50.598600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.598576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7\" (UID: \"e2d50089-7106-4c01-9d8b-bbaef9e9d746\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:50.638100 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.638063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:41:50.711978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:50.711945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:51.003108 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:51.003074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"]
Sep 10 22:41:51.005462 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:41:51.005431    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d50089_7106_4c01_9d8b_bbaef9e9d746.slice/crio-903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381 WatchSource:0}: Error finding container 903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381: Status 404 returned error can't find the container with id 903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381
Sep 10 22:41:51.643868 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:51.643823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7" event={"ID":"e2d50089-7106-4c01-9d8b-bbaef9e9d746","Type":"ContainerStarted","Data":"1b94b0131a7d7b26bf8a33e13175b1c02612aaa839e8ceb80cb65c0375d0e2bb"}
Sep 10 22:41:51.644021 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:51.643897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7" event={"ID":"e2d50089-7106-4c01-9d8b-bbaef9e9d746","Type":"ContainerStarted","Data":"903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381"}
Sep 10 22:41:51.660868 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:51.660810    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7" podStartSLOduration=1.660787072 podStartE2EDuration="1.660787072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:51.659385495 +0000 UTC m=+1418.243462550" watchObservedRunningTime="2026-09-10 22:41:51.660787072 +0000 UTC m=+1418.244864174"
Sep 10 22:41:52.650552 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:52.650519    2559 generic.go:356] "Generic (PLEG): container finished" podID="e2d50089-7106-4c01-9d8b-bbaef9e9d746" containerID="1b94b0131a7d7b26bf8a33e13175b1c02612aaa839e8ceb80cb65c0375d0e2bb" exitCode=0
Sep 10 22:41:52.650957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:52.650567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7" event={"ID":"e2d50089-7106-4c01-9d8b-bbaef9e9d746","Type":"ContainerDied","Data":"1b94b0131a7d7b26bf8a33e13175b1c02612aaa839e8ceb80cb65c0375d0e2bb"}
Sep 10 22:41:53.789565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:53.789528    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:53.927712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:53.927620    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca\") pod \"e2d50089-7106-4c01-9d8b-bbaef9e9d746\" (UID: \"e2d50089-7106-4c01-9d8b-bbaef9e9d746\") "
Sep 10 22:41:53.928008 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:53.927981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2d50089-7106-4c01-9d8b-bbaef9e9d746" (UID: "e2d50089-7106-4c01-9d8b-bbaef9e9d746"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:54.029052 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:54.029007    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d50089-7106-4c01-9d8b-bbaef9e9d746-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:41:54.661198 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:54.661166    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"
Sep 10 22:41:54.661378 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:54.661210    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7" event={"ID":"e2d50089-7106-4c01-9d8b-bbaef9e9d746","Type":"ContainerDied","Data":"903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381"}
Sep 10 22:41:54.661378 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:54.661261    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="903fb2432ed06444544901c42dcd0bbb591b2151c159c05296923377e49bf381"
Sep 10 22:41:55.970746 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:41:55.970703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:01.138439 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.138396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.184706 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.184661    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:42:01.184978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.184929    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" podUID="907e5e4e-3555-4a74-9333-7e510c3caab8" containerName="payload-processing" containerID="cri-o://5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829" gracePeriod=30
Sep 10 22:42:01.197905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.197877    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:42:01.198089 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.198070    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" podUID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" containerName="payload-pre-processing" containerID="cri-o://6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7" gracePeriod=30
Sep 10 22:42:01.239047 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.239012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.322267 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.322231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.388992 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.388904    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"]
Sep 10 22:42:01.390935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.390904    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.391586 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.391566    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-7a7e94-9qfm7"]
Sep 10 22:42:01.450354 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.450315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.475299 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.475272    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:42:01.478130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.478081    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:42:01.595961 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.595927    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume\") pod \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") "
Sep 10 22:42:01.596164 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.595996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxpp5\" (UniqueName: \"kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5\") pod \"907e5e4e-3555-4a74-9333-7e510c3caab8\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") "
Sep 10 22:42:01.596164 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.596035    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czt9w\" (UniqueName: \"kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w\") pod \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\" (UID: \"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0\") "
Sep 10 22:42:01.596164 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.596104    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume\") pod \"907e5e4e-3555-4a74-9333-7e510c3caab8\" (UID: \"907e5e4e-3555-4a74-9333-7e510c3caab8\") "
Sep 10 22:42:01.596453 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.596403    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" (UID: "1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:01.596663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.596636    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "907e5e4e-3555-4a74-9333-7e510c3caab8" (UID: "907e5e4e-3555-4a74-9333-7e510c3caab8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:01.598253 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.598228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5" (OuterVolumeSpecName: "kube-api-access-dxpp5") pod "907e5e4e-3555-4a74-9333-7e510c3caab8" (UID: "907e5e4e-3555-4a74-9333-7e510c3caab8"). InnerVolumeSpecName "kube-api-access-dxpp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:01.598253 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.598252    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w" (OuterVolumeSpecName: "kube-api-access-czt9w") pod "1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" (UID: "1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0"). InnerVolumeSpecName "kube-api-access-czt9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:01.697703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.697617    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:01.697703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.697640    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxpp5\" (UniqueName: \"kubernetes.io/projected/907e5e4e-3555-4a74-9333-7e510c3caab8-kube-api-access-dxpp5\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:01.697703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.697673    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czt9w\" (UniqueName: \"kubernetes.io/projected/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0-kube-api-access-czt9w\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:01.697703 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.697683    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907e5e4e-3555-4a74-9333-7e510c3caab8-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:01.700289 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.700262    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" containerID="6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7" exitCode=0
Sep 10 22:42:01.700431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.700305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"
Sep 10 22:42:01.700431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.700351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" event={"ID":"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0","Type":"ContainerDied","Data":"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"}
Sep 10 22:42:01.700431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.700415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc" event={"ID":"1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0","Type":"ContainerDied","Data":"5bfeca6ae9b3eb4f5f789cf5f305ac825f5280e5575ae0ff2d337929d6bd2d0e"}
Sep 10 22:42:01.700627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.700442    2559 scope.go:117] "RemoveContainer" containerID="6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"
Sep 10 22:42:01.702155 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.702117    2559 generic.go:356] "Generic (PLEG): container finished" podID="907e5e4e-3555-4a74-9333-7e510c3caab8" containerID="5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829" exitCode=0
Sep 10 22:42:01.702273 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.702213    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"
Sep 10 22:42:01.702339 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.702217    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" event={"ID":"907e5e4e-3555-4a74-9333-7e510c3caab8","Type":"ContainerDied","Data":"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"}
Sep 10 22:42:01.702391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.702363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp" event={"ID":"907e5e4e-3555-4a74-9333-7e510c3caab8","Type":"ContainerDied","Data":"b55ae246ab010447fe82f17eb9cc2e55953f147fb5ffc92fef1e150d1a3c18c0"}
Sep 10 22:42:01.710621 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.710599    2559 scope.go:117] "RemoveContainer" containerID="6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"
Sep 10 22:42:01.710986 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:42:01.710965    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7\": container with ID starting with 6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7 not found: ID does not exist" containerID="6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"
Sep 10 22:42:01.711077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.710999    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7"} err="failed to get container status \"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7\": rpc error: code = NotFound desc = could not find container \"6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7\": container with ID starting with 6f2b13cd92f94f38cabbd23e8f287a95fc0df8f8868b504d39665b1958e318b7 not found: ID does not exist"
Sep 10 22:42:01.711077 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.711022    2559 scope.go:117] "RemoveContainer" containerID="5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"
Sep 10 22:42:01.719796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.719770    2559 scope.go:117] "RemoveContainer" containerID="5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"
Sep 10 22:42:01.720096 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:42:01.720076    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829\": container with ID starting with 5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829 not found: ID does not exist" containerID="5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"
Sep 10 22:42:01.720165 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.720105    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829"} err="failed to get container status \"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829\": rpc error: code = NotFound desc = could not find container \"5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829\": container with ID starting with 5d05276e7a86b2fada6d561540bb5a7dc9d2e0bc8350f617ef7c27ee0c385829 not found: ID does not exist"
Sep 10 22:42:01.727065 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.727035    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:42:01.730595 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.730572    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc"]
Sep 10 22:42:01.741297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.741268    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:42:01.746266 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.746235    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp"]
Sep 10 22:42:01.754564 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.754535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:01.891296 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.891266    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" path="/var/lib/kubelet/pods/1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0/volumes"
Sep 10 22:42:01.891653 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.891640    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907e5e4e-3555-4a74-9333-7e510c3caab8" path="/var/lib/kubelet/pods/907e5e4e-3555-4a74-9333-7e510c3caab8/volumes"
Sep 10 22:42:01.891954 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:01.891942    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d50089-7106-4c01-9d8b-bbaef9e9d746" path="/var/lib/kubelet/pods/e2d50089-7106-4c01-9d8b-bbaef9e9d746/volumes"
Sep 10 22:42:05.750501 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:05.750459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:07.612470 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:07.612430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:07.713432 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:07.713394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:07.887438 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:07.887345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:08.199911 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.199883    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"]
Sep 10 22:42:08.200246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200233    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" containerName="payload-pre-processing"
Sep 10 22:42:08.200301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200247    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" containerName="payload-pre-processing"
Sep 10 22:42:08.200301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200263    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d50089-7106-4c01-9d8b-bbaef9e9d746" containerName="revoke-keys"
Sep 10 22:42:08.200301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200269    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d50089-7106-4c01-9d8b-bbaef9e9d746" containerName="revoke-keys"
Sep 10 22:42:08.200301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200278    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907e5e4e-3555-4a74-9333-7e510c3caab8" containerName="payload-processing"
Sep 10 22:42:08.200301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200284    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="907e5e4e-3555-4a74-9333-7e510c3caab8" containerName="payload-processing"
Sep 10 22:42:08.200469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200343    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1c1ac9-0548-49b4-b5e6-6834c56fc1f0" containerName="payload-pre-processing"
Sep 10 22:42:08.200469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200352    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="907e5e4e-3555-4a74-9333-7e510c3caab8" containerName="payload-processing"
Sep 10 22:42:08.200469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.200359    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d50089-7106-4c01-9d8b-bbaef9e9d746" containerName="revoke-keys"
Sep 10 22:42:08.204923 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.204900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:08.207315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.207287    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:42:08.207443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.207339    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:42:08.211038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.211005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"]
Sep 10 22:42:08.315693 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.315658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:08.364114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.364081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f\" (UID: \"af0990c1-8637-43fc-b906-620aae2ddb94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:08.465589 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.465463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f\" (UID: \"af0990c1-8637-43fc-b906-620aae2ddb94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:08.466130 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.466109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f\" (UID: \"af0990c1-8637-43fc-b906-620aae2ddb94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:08.516437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.516404    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:08.788736 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:08.788706    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"]
Sep 10 22:42:08.790760 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:42:08.790733    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0990c1_8637_43fc_b906_620aae2ddb94.slice/crio-c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970 WatchSource:0}: Error finding container c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970: Status 404 returned error can't find the container with id c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970
Sep 10 22:42:09.748073 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:09.748037    2559 generic.go:356] "Generic (PLEG): container finished" podID="af0990c1-8637-43fc-b906-620aae2ddb94" containerID="8fbdaaa8e35bcbff59ae4dbd93dc6b531f4a87e812339dd511ac140478be681d" exitCode=0
Sep 10 22:42:09.748260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:09.748123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f" event={"ID":"af0990c1-8637-43fc-b906-620aae2ddb94","Type":"ContainerDied","Data":"8fbdaaa8e35bcbff59ae4dbd93dc6b531f4a87e812339dd511ac140478be681d"}
Sep 10 22:42:09.748260 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:09.748180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f" event={"ID":"af0990c1-8637-43fc-b906-620aae2ddb94","Type":"ContainerStarted","Data":"c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970"}
Sep 10 22:42:10.884166 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:10.884139    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:10.888265 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:10.888240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca\") pod \"af0990c1-8637-43fc-b906-620aae2ddb94\" (UID: \"af0990c1-8637-43fc-b906-620aae2ddb94\") "
Sep 10 22:42:10.888674 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:10.888651    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af0990c1-8637-43fc-b906-620aae2ddb94" (UID: "af0990c1-8637-43fc-b906-620aae2ddb94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:10.989177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:10.989140    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0990c1-8637-43fc-b906-620aae2ddb94-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:11.760288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:11.760254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"
Sep 10 22:42:11.760288 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:11.760263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f" event={"ID":"af0990c1-8637-43fc-b906-620aae2ddb94","Type":"ContainerDied","Data":"c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970"}
Sep 10 22:42:11.760526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:11.760314    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0a53387157b326bb9b118ef72f7c52482cfeb24b5022bfaf0f686d299acb970"
Sep 10 22:42:12.249590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.249555    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:42:12.250103 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.250084    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0990c1-8637-43fc-b906-620aae2ddb94" containerName="revoke-keys"
Sep 10 22:42:12.250148 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.250107    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0990c1-8637-43fc-b906-620aae2ddb94" containerName="revoke-keys"
Sep 10 22:42:12.250219 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.250207    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0990c1-8637-43fc-b906-620aae2ddb94" containerName="revoke-keys"
Sep 10 22:42:12.253866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.253844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.256569 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.256547    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"openshift-service-ca.crt\""
Sep 10 22:42:12.256733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.256679    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"kube-root-ca.crt\""
Sep 10 22:42:12.256733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.256679    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"default-dockercfg-8fjss\""
Sep 10 22:42:12.256733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.256713    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-33b4cf\"/\"rate-test-model-33b4cf-kserve-self-signed-certs\""
Sep 10 22:42:12.261891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.261865    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:42:12.301246 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301437 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2xb\" (UniqueName: \"kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.301663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.301528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:12.402465 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402465 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2xb\" (UniqueName: \"kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402755 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.402988 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.402953    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.403064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.403005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.404913 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.404891    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.405013 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.404995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.410811 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.410783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2xb\" (UniqueName: \"kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb\") pod \"rate-test-model-33b4cf-kserve-77955c8dff-xchjs\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") " pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.566668 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.566572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:12.840238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:12.840211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:42:12.842400 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:42:12.842374    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb944f0f_3080_42fd_a23b_8f4d4dc9b08f.slice/crio-d40d4c2824646de9cc4fe1402cf84c0fc32e3931b14f169724ee7ad46cf38751 WatchSource:0}: Error finding container d40d4c2824646de9cc4fe1402cf84c0fc32e3931b14f169724ee7ad46cf38751: Status 404 returned error can't find the container with id d40d4c2824646de9cc4fe1402cf84c0fc32e3931b14f169724ee7ad46cf38751
Sep 10 22:42:13.772121 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:13.772074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" event={"ID":"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f","Type":"ContainerStarted","Data":"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"}
Sep 10 22:42:13.772576 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:13.772134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" event={"ID":"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f","Type":"ContainerStarted","Data":"d40d4c2824646de9cc4fe1402cf84c0fc32e3931b14f169724ee7ad46cf38751"}
Sep 10 22:42:13.788279 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:13.788225    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" podStartSLOduration=1.788209277 podStartE2EDuration="1.788209277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:42:13.787726593 +0000 UTC m=+1440.371803630" watchObservedRunningTime="2026-09-10 22:42:13.788209277 +0000 UTC m=+1440.372286317"
Sep 10 22:42:18.185584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.185533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:18.851407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.851373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:18.881580 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.881531    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:42:18.881855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.881822    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerName="payload-processing" containerID="cri-o://08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094" gracePeriod=30
Sep 10 22:42:18.894824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.894790    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:42:18.895195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.895134    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerName="payload-pre-processing" containerID="cri-o://7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e" gracePeriod=30
Sep 10 22:42:18.920324 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.920276    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.62:9004: connect: connection refused"
Sep 10 22:42:18.920555 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.920292    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.61:9004: connect: connection refused"
Sep 10 22:42:18.950589 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:18.950552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:19.080642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.080607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:19.145918 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.145888    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"]
Sep 10 22:42:19.148977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.148949    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-25e5bd-5zf5f"]
Sep 10 22:42:19.157398 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.157359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:19.168456 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.168427    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:42:19.171292 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.171269    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:42:19.267977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.267936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tgzv\" (UniqueName: \"kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv\") pod \"3a5c1af1-8d3b-422d-8805-a23fa232997f\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") "
Sep 10 22:42:19.268458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.267989    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume\") pod \"f74255b0-ad56-4a76-92a2-e4644f1334b2\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") "
Sep 10 22:42:19.268458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.268009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trp74\" (UniqueName: \"kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74\") pod \"f74255b0-ad56-4a76-92a2-e4644f1334b2\" (UID: \"f74255b0-ad56-4a76-92a2-e4644f1334b2\") "
Sep 10 22:42:19.268458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.268038    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume\") pod \"3a5c1af1-8d3b-422d-8805-a23fa232997f\" (UID: \"3a5c1af1-8d3b-422d-8805-a23fa232997f\") "
Sep 10 22:42:19.268458 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.268414    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f74255b0-ad56-4a76-92a2-e4644f1334b2" (UID: "f74255b0-ad56-4a76-92a2-e4644f1334b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:19.268662 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.268457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a5c1af1-8d3b-422d-8805-a23fa232997f" (UID: "3a5c1af1-8d3b-422d-8805-a23fa232997f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:19.270171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.270149    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv" (OuterVolumeSpecName: "kube-api-access-9tgzv") pod "3a5c1af1-8d3b-422d-8805-a23fa232997f" (UID: "3a5c1af1-8d3b-422d-8805-a23fa232997f"). InnerVolumeSpecName "kube-api-access-9tgzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:19.270227 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.270166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74" (OuterVolumeSpecName: "kube-api-access-trp74") pod "f74255b0-ad56-4a76-92a2-e4644f1334b2" (UID: "f74255b0-ad56-4a76-92a2-e4644f1334b2"). InnerVolumeSpecName "kube-api-access-trp74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:19.368661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.368626    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tgzv\" (UniqueName: \"kubernetes.io/projected/3a5c1af1-8d3b-422d-8805-a23fa232997f-kube-api-access-9tgzv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.368661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.368655    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f74255b0-ad56-4a76-92a2-e4644f1334b2-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.368661 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.368666    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trp74\" (UniqueName: \"kubernetes.io/projected/f74255b0-ad56-4a76-92a2-e4644f1334b2-kube-api-access-trp74\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.368904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.368675    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a5c1af1-8d3b-422d-8805-a23fa232997f-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.534761 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.534721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:19.801723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.801628    2559 generic.go:356] "Generic (PLEG): container finished" podID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerID="7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e" exitCode=0
Sep 10 22:42:19.801723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.801677    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"
Sep 10 22:42:19.801978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.801717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" event={"ID":"f74255b0-ad56-4a76-92a2-e4644f1334b2","Type":"ContainerDied","Data":"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"}
Sep 10 22:42:19.801978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.801773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x" event={"ID":"f74255b0-ad56-4a76-92a2-e4644f1334b2","Type":"ContainerDied","Data":"865ad9368cfbc5cb42064eeb40bcfcaddf2100bed0bf740fa8984c4eedfc0e2d"}
Sep 10 22:42:19.801978 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.801801    2559 scope.go:117] "RemoveContainer" containerID="7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"
Sep 10 22:42:19.803123 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.803101    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerID="08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094" exitCode=0
Sep 10 22:42:19.803193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.803134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" event={"ID":"3a5c1af1-8d3b-422d-8805-a23fa232997f","Type":"ContainerDied","Data":"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"}
Sep 10 22:42:19.803193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.803146    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"
Sep 10 22:42:19.803193 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.803176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv" event={"ID":"3a5c1af1-8d3b-422d-8805-a23fa232997f","Type":"ContainerDied","Data":"01938a35256345730ef9877b786c596c32c6b1c9756dbb6a1f9fc0b000a9fafd"}
Sep 10 22:42:19.810951 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.810923    2559 scope.go:117] "RemoveContainer" containerID="7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"
Sep 10 22:42:19.811233 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:42:19.811212    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e\": container with ID starting with 7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e not found: ID does not exist" containerID="7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"
Sep 10 22:42:19.811338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.811240    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e"} err="failed to get container status \"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e\": rpc error: code = NotFound desc = could not find container \"7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e\": container with ID starting with 7173a14d5a15598ff99e72b719cf9311bdd81c285a96d05c306f9f58a025cc7e not found: ID does not exist"
Sep 10 22:42:19.811338 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.811255    2559 scope.go:117] "RemoveContainer" containerID="08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"
Sep 10 22:42:19.819511 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.819463    2559 scope.go:117] "RemoveContainer" containerID="08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"
Sep 10 22:42:19.819745 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:42:19.819727    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094\": container with ID starting with 08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094 not found: ID does not exist" containerID="08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"
Sep 10 22:42:19.819796 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.819752    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094"} err="failed to get container status \"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094\": rpc error: code = NotFound desc = could not find container \"08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094\": container with ID starting with 08e70a8e3aa2718ac565f4ec2641dcf0b465f66a21b9dfc47cea2723feab5094 not found: ID does not exist"
Sep 10 22:42:19.825950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.825924    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:42:19.829307 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.829283    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x"]
Sep 10 22:42:19.839775 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.839747    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:42:19.841387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.841368    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv"]
Sep 10 22:42:19.891667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.891636    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" path="/var/lib/kubelet/pods/3a5c1af1-8d3b-422d-8805-a23fa232997f/volumes"
Sep 10 22:42:19.892012 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.891999    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0990c1-8637-43fc-b906-620aae2ddb94" path="/var/lib/kubelet/pods/af0990c1-8637-43fc-b906-620aae2ddb94/volumes"
Sep 10 22:42:19.892315 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:19.892304    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" path="/var/lib/kubelet/pods/f74255b0-ad56-4a76-92a2-e4644f1334b2/volumes"
Sep 10 22:42:22.567515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:22.567444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:22.567515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:22.567527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:22.580270 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:22.580236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:22.831056 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:22.830972    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:42:24.644301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:24.644259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:24.744652 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:24.744620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:25.526627 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:25.526587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:25.625094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:25.625055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:25.795526 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:25.795414    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:31.245396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:31.245353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:46.342037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:46.341996    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:46.352816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:46.352762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:46.419788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:46.419734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:46.521197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:46.521150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:52.991556 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:52.991515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:53.958063 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:53.958032    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:42:53.984430 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:53.984397    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:54.411249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:54.411159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:54.711822 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:54.711793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:54.805200 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:54.805162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:57.340352 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:57.340319    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:42:57.620365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:57.620275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:57.718565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:57.718523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:58.933319 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:58.933282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:59.005733 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.005701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:59.442215 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.442133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:59.553890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.553847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:42:59.589287 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589242    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:42:59.589727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589671    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerName="payload-pre-processing"
Sep 10 22:42:59.589727 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589728    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerName="payload-pre-processing"
Sep 10 22:42:59.589935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589757    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerName="payload-processing"
Sep 10 22:42:59.589935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589766    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerName="payload-processing"
Sep 10 22:42:59.589935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589847    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a5c1af1-8d3b-422d-8805-a23fa232997f" containerName="payload-processing"
Sep 10 22:42:59.589935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.589863    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f74255b0-ad56-4a76-92a2-e4644f1334b2" containerName="payload-pre-processing"
Sep 10 22:42:59.593049 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.593028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.595675 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.595650    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-16d0fd-dockercfg-w25j4\""
Sep 10 22:42:59.595810 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.595693    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-16d0fd\""
Sep 10 22:42:59.604132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.604106    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:42:59.621463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.621428    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:42:59.624680 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.624664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.629616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.629590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.629779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.629638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frrh2\" (UniqueName: \"kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.635268 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.635240    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:42:59.730909 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.730867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.731114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.730933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frrh2\" (UniqueName: \"kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.731114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.730978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.731114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.731044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm4tv\" (UniqueName: \"kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.731634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.731613    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.739345 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.739322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frrh2\" (UniqueName: \"kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2\") pod \"payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.831844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.831802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.832020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.831874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm4tv\" (UniqueName: \"kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.832616 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.832597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.840108 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.840086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm4tv\" (UniqueName: \"kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv\") pod \"payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:42:59.904950 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.904915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:42:59.936700 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:42:59.936662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:43:00.181198 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:00.181163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:43:00.183504 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:43:00.183465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6de3365_bba1_4915_b169_5d1a74ec8de3.slice/crio-3a0adf87e21d9833298b7b1264e3a1f2032ea16f286dd3896e8054348656359a WatchSource:0}: Error finding container 3a0adf87e21d9833298b7b1264e3a1f2032ea16f286dd3896e8054348656359a: Status 404 returned error can't find the container with id 3a0adf87e21d9833298b7b1264e3a1f2032ea16f286dd3896e8054348656359a
Sep 10 22:43:00.229396 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:00.225435    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:43:00.237591 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:43:00.237560    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b489aa_457b_4048_907b_4bdb883bb6a4.slice/crio-89a0b4895108866bc3bc88c76986d26f26bea97df00b3d9b2f603a869d89564f WatchSource:0}: Error finding container 89a0b4895108866bc3bc88c76986d26f26bea97df00b3d9b2f603a869d89564f: Status 404 returned error can't find the container with id 89a0b4895108866bc3bc88c76986d26f26bea97df00b3d9b2f603a869d89564f
Sep 10 22:43:01.011972 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.011937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" event={"ID":"d6de3365-bba1-4915-b169-5d1a74ec8de3","Type":"ContainerStarted","Data":"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"}
Sep 10 22:43:01.012406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.011990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" event={"ID":"d6de3365-bba1-4915-b169-5d1a74ec8de3","Type":"ContainerStarted","Data":"3a0adf87e21d9833298b7b1264e3a1f2032ea16f286dd3896e8054348656359a"}
Sep 10 22:43:01.012406 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.012049    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:43:01.013641 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.013618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" event={"ID":"79b489aa-457b-4048-907b-4bdb883bb6a4","Type":"ContainerStarted","Data":"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"}
Sep 10 22:43:01.013754 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.013657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" event={"ID":"79b489aa-457b-4048-907b-4bdb883bb6a4","Type":"ContainerStarted","Data":"89a0b4895108866bc3bc88c76986d26f26bea97df00b3d9b2f603a869d89564f"}
Sep 10 22:43:01.013754 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.013678    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:43:01.029153 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.029099    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" podStartSLOduration=2.029083598 podStartE2EDuration="2.029083598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:43:01.028289588 +0000 UTC m=+1487.612366640" watchObservedRunningTime="2026-09-10 22:43:01.029083598 +0000 UTC m=+1487.613160638"
Sep 10 22:43:01.044387 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:01.044329    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" podStartSLOduration=2.044311318 podStartE2EDuration="2.044311318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:43:01.042876218 +0000 UTC m=+1487.626953257" watchObservedRunningTime="2026-09-10 22:43:01.044311318 +0000 UTC m=+1487.628388358"
Sep 10 22:43:07.843927 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:07.843880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:43:08.978191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:08.978149    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" podUID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" containerName="main" containerID="cri-o://30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc" gracePeriod=45
Sep 10 22:43:09.228535 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.228450    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:43:09.326255 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326265    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326302    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj2xb\" (UniqueName: \"kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326347    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326452 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir\") pod \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\" (UID: \"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f\") "
Sep 10 22:43:09.326732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326605    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:09.326732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326619    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home" (OuterVolumeSpecName: "home") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:09.326883 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.326859    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:09.328687 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.328664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:43:09.328767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.328666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb" (OuterVolumeSpecName: "kube-api-access-mj2xb") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "kube-api-access-mj2xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:43:09.328767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.328673    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm" (OuterVolumeSpecName: "dshm") pod "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" (UID: "bb944f0f-3080-42fd-a23b-8f4d4dc9b08f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:09.427917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427877    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:09.427917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427909    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:09.427917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427919    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:09.427917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427929    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj2xb\" (UniqueName: \"kubernetes.io/projected/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-kube-api-access-mj2xb\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:09.428191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427938    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:09.428191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:09.427946    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:43:10.058067 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.058035    2559 generic.go:356] "Generic (PLEG): container finished" podID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" containerID="30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc" exitCode=0
Sep 10 22:43:10.058560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.058080    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"
Sep 10 22:43:10.058560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.058118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" event={"ID":"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f","Type":"ContainerDied","Data":"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"}
Sep 10 22:43:10.058560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.058161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs" event={"ID":"bb944f0f-3080-42fd-a23b-8f4d4dc9b08f","Type":"ContainerDied","Data":"d40d4c2824646de9cc4fe1402cf84c0fc32e3931b14f169724ee7ad46cf38751"}
Sep 10 22:43:10.058560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.058179    2559 scope.go:117] "RemoveContainer" containerID="30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"
Sep 10 22:43:10.067147 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.067116    2559 scope.go:117] "RemoveContainer" containerID="30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"
Sep 10 22:43:10.067463 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:43:10.067437    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc\": container with ID starting with 30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc not found: ID does not exist" containerID="30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"
Sep 10 22:43:10.067557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.067476    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc"} err="failed to get container status \"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc\": rpc error: code = NotFound desc = could not find container \"30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc\": container with ID starting with 30bdb310daf8bfc2045af0498cfe6d4a4044c34854b766ae0b07aef75ffb0dcc not found: ID does not exist"
Sep 10 22:43:10.077295 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.077267    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:43:10.084228 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:10.084199    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-33b4cf/rate-test-model-33b4cf-kserve-77955c8dff-xchjs"]
Sep 10 22:43:11.891910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:11.891869    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" path="/var/lib/kubelet/pods/bb944f0f-3080-42fd-a23b-8f4d4dc9b08f/volumes"
Sep 10 22:43:12.021150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:12.021118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:43:12.021330 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:12.021199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:43:22.606924 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:22.606872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:23.284897 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:23.284825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:23.738257 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:23.738222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:24.050858 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:24.050761    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:26.830897 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:26.830825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.008420 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.008378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.112904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.112872    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.437774 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.437673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.581515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.581456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.679641 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.679598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:28.718584 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.718549    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:43:28.718920 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.718904    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" containerName="main"
Sep 10 22:43:28.718973 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.718922    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" containerName="main"
Sep 10 22:43:28.719015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.719002    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb944f0f-3080-42fd-a23b-8f4d4dc9b08f" containerName="main"
Sep 10 22:43:28.722086 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.722066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:28.724609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.724570    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d28770-dockercfg-r29br\""
Sep 10 22:43:28.724609 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.724578    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d28770\""
Sep 10 22:43:28.737293 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.737267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:43:28.900191 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.900150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:28.900377 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:28.900202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g92zv\" (UniqueName: \"kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.001764 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.001667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.001764 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.001719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g92zv\" (UniqueName: \"kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.002424 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.002401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.010170 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.010129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g92zv\" (UniqueName: \"kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv\") pod \"payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.031997 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.031962    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:29.305169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:29.305138    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:43:29.307760 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:43:29.307722    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d6f639_9acd_499a_aa60_56da66848c02.slice/crio-605c1cb4c854b7af6abc5de96f6d2b943470851d4c421441ccb4791c487438b8 WatchSource:0}: Error finding container 605c1cb4c854b7af6abc5de96f6d2b943470851d4c421441ccb4791c487438b8: Status 404 returned error can't find the container with id 605c1cb4c854b7af6abc5de96f6d2b943470851d4c421441ccb4791c487438b8
Sep 10 22:43:30.159922 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:30.159886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" event={"ID":"95d6f639-9acd-499a-aa60-56da66848c02","Type":"ContainerStarted","Data":"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"}
Sep 10 22:43:30.160304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:30.159935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" event={"ID":"95d6f639-9acd-499a-aa60-56da66848c02","Type":"ContainerStarted","Data":"605c1cb4c854b7af6abc5de96f6d2b943470851d4c421441ccb4791c487438b8"}
Sep 10 22:43:30.160304 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:30.159979    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:30.179955 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:30.179894    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" podStartSLOduration=2.17987648 podStartE2EDuration="2.17987648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:43:30.178522249 +0000 UTC m=+1516.762599280" watchObservedRunningTime="2026-09-10 22:43:30.17987648 +0000 UTC m=+1516.763953571"
Sep 10 22:43:33.652023 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:33.651982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:43:41.167734 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:41.167644    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:43:51.795835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:51.795799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:43:56.904824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:43:56.904791    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb_95d6f639-9acd-499a-aa60-56da66848c02/payload-processing/0.log"
Sep 10 22:44:02.435654 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.435619    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:44:02.439279 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.439262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.442930 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.442895    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-16d0fd\"/\"kube-root-ca.crt\""
Sep 10 22:44:02.442930 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.442926    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-16d0fd\"/\"default-dockercfg-ckh49\""
Sep 10 22:44:02.443128 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.442951    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-16d0fd\"/\"ipp-route-16d0fd-kserve-self-signed-certs\""
Sep 10 22:44:02.443128 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.442925    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-16d0fd\"/\"openshift-service-ca.crt\""
Sep 10 22:44:02.447362 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.447338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:44:02.453882 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.453855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:02.503432 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.503644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.503644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.503644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs4p4\" (UniqueName: \"kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.503644 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.503834 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.503666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604745 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs4p4\" (UniqueName: \"kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.604964 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.604930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.605249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.605199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.605249 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.605217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.605356 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.605254    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.607317 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.607291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.607529 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.607512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.613620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.613601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs4p4\" (UniqueName: \"kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4\") pod \"ipp-route-16d0fd-kserve-6f45f685d7-7x74m\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") " pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:02.749540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:02.749472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:03.023724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:03.023695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:44:03.025830 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:44:03.025795    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69222743_16df_42e5_bd19_aae7f26dc32d.slice/crio-b186b5425cb9ee67d848c9cb35c0f6bf5f822e4c142b28db7f42fccca21c584e WatchSource:0}: Error finding container b186b5425cb9ee67d848c9cb35c0f6bf5f822e4c142b28db7f42fccca21c584e: Status 404 returned error can't find the container with id b186b5425cb9ee67d848c9cb35c0f6bf5f822e4c142b28db7f42fccca21c584e
Sep 10 22:44:03.324600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:03.324478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" event={"ID":"69222743-16df-42e5-bd19-aae7f26dc32d","Type":"ContainerStarted","Data":"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"}
Sep 10 22:44:03.324600 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:03.324556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" event={"ID":"69222743-16df-42e5-bd19-aae7f26dc32d","Type":"ContainerStarted","Data":"b186b5425cb9ee67d848c9cb35c0f6bf5f822e4c142b28db7f42fccca21c584e"}
Sep 10 22:44:03.342291 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:03.342233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" podStartSLOduration=1.342217078 podStartE2EDuration="1.342217078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:44:03.340231325 +0000 UTC m=+1549.924308379" watchObservedRunningTime="2026-09-10 22:44:03.342217078 +0000 UTC m=+1549.926294118"
Sep 10 22:44:06.744704 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:06.744666    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:44:12.750587 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:12.750547    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:12.751143 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:12.750729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:12.763198 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:12.763167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:13.386171 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:13.386135    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:44:14.154824 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:14.154794    2559 scope.go:117] "RemoveContainer" containerID="897b74a42d19e627bf1259ae6683776e84076fefe9788e9281ea9cc691ff93bd"
Sep 10 22:44:31.440083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:31.440022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:44:36.733038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:36.732998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:37.595149 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:37.595114    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf_d6de3365-bba1-4915-b169-5d1a74ec8de3/payload-processing/0.log"
Sep 10 22:44:37.827738 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:37.827709    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb_95d6f639-9acd-499a-aa60-56da66848c02/payload-processing/0.log"
Sep 10 22:44:38.094303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:38.094270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:38.400471 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:38.400377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:38.500483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:38.500448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:41.926912 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:41.926869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:42.021434 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:42.021392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.338348 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.338299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.424385 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.424333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.709704 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.709667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.845687 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.845643    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.947695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.947667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:44:43.969974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.969893    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:44:43.973678 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.973656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:43.975945 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.975921    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-6b8825\""
Sep 10 22:44:43.984252 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:43.984219    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:44:44.030385 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.030348    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:44:44.033773 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.033747    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.036181 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.036150    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-6b8825-dockercfg-25gp9\""
Sep 10 22:44:44.044300 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.044266    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:44:44.085140 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.085100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.085319 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.085151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znn8x\" (UniqueName: \"kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.085319 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.085211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stzr\" (UniqueName: \"kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.085319 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.085255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.185863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.185805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.186096 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.185886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znn8x\" (UniqueName: \"kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.186096 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.185914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stzr\" (UniqueName: \"kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.186096 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.185946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.186736 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.186709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.186871 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.186851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.195150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.195114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znn8x\" (UniqueName: \"kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x\") pod \"payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.195305 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.195114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stzr\" (UniqueName: \"kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr\") pod \"payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.285842 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.285732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:44.346109 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.345933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:44.559762 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.559725    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:44:44.561639 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:44:44.561611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-27d4397b72e0591364a856cff5012295f500873d886670a28c9c6f41ce1ac0d6 WatchSource:0}: Error finding container 27d4397b72e0591364a856cff5012295f500873d886670a28c9c6f41ce1ac0d6: Status 404 returned error can't find the container with id 27d4397b72e0591364a856cff5012295f500873d886670a28c9c6f41ce1ac0d6
Sep 10 22:44:44.624966 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:44.622858    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:44:45.540927 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.540888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" event={"ID":"fa49dc84-132c-49d2-8b88-b2574d74cf96","Type":"ContainerStarted","Data":"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"}
Sep 10 22:44:45.541389 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.540957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" event={"ID":"fa49dc84-132c-49d2-8b88-b2574d74cf96","Type":"ContainerStarted","Data":"27d4397b72e0591364a856cff5012295f500873d886670a28c9c6f41ce1ac0d6"}
Sep 10 22:44:45.541389 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.540990    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:45.542459 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.542436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" event={"ID":"9396a012-800f-4be4-9335-7d7f7a2eb112","Type":"ContainerStarted","Data":"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"}
Sep 10 22:44:45.542595 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.542475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" event={"ID":"9396a012-800f-4be4-9335-7d7f7a2eb112","Type":"ContainerStarted","Data":"6cf16b94f2e952b080efff932735abf2f8efc414a38a204237b8ad7da944feb1"}
Sep 10 22:44:45.542595 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.542531    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:44:45.557586 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.557529    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" podStartSLOduration=2.557512257 podStartE2EDuration="2.557512257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:44:45.555880179 +0000 UTC m=+1592.139957220" watchObservedRunningTime="2026-09-10 22:44:45.557512257 +0000 UTC m=+1592.141589293"
Sep 10 22:44:45.571977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:45.571916    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" podStartSLOduration=1.57190158 podStartE2EDuration="1.57190158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:44:45.570112207 +0000 UTC m=+1592.154189274" watchObservedRunningTime="2026-09-10 22:44:45.57190158 +0000 UTC m=+1592.155978674"
Sep 10 22:44:51.244817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:51.244782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:44:56.549047 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:56.549016    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:44:56.549463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:44:56.549357    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:45:00.135850 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.135807    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"]
Sep 10 22:45:00.139630 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.139594    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"]
Sep 10 22:45:00.139812 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.139724    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"
Sep 10 22:45:00.142132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.142109    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:45:00.142891 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.142873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"]
Sep 10 22:45:00.143005 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.142982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"
Sep 10 22:45:00.145935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.145915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"
Sep 10 22:45:00.150858 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.150823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"]
Sep 10 22:45:00.155164 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.155115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"
Sep 10 22:45:00.155528 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.155263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"]
Sep 10 22:45:00.166146 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.165984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"]
Sep 10 22:45:00.168007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.167975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"
Sep 10 22:45:00.169693 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.169666    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"]
Sep 10 22:45:00.175538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.175469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"
Sep 10 22:45:00.177347 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.177311    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"]
Sep 10 22:45:00.212608 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.212558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"
Sep 10 22:45:00.222297 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.222254    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"
Sep 10 22:45:00.473090 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.473062    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"]
Sep 10 22:45:00.477583 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:00.477550    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee9714f_37b0_4cc0_b385_b527bb773ae9.slice/crio-f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374 WatchSource:0}: Error finding container f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374: Status 404 returned error can't find the container with id f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374
Sep 10 22:45:00.478328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.478298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"]
Sep 10 22:45:00.478452 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:00.478338    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbc9285_011d_469e_99ba_f6ec478f4019.slice/crio-80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9 WatchSource:0}: Error finding container 80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9: Status 404 returned error can't find the container with id 80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9
Sep 10 22:45:00.512145 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.512121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"]
Sep 10 22:45:00.514011 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:00.513982    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916d260b_3f10_455f_814f_cc52c285deed.slice/crio-5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c WatchSource:0}: Error finding container 5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c: Status 404 returned error can't find the container with id 5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c
Sep 10 22:45:00.522383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.522331    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"]
Sep 10 22:45:00.524535 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:00.524479    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6873956_fa0d_4883_801a_fb657d6cb640.slice/crio-951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3 WatchSource:0}: Error finding container 951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3: Status 404 returned error can't find the container with id 951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3
Sep 10 22:45:00.620407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.620368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr" event={"ID":"0cbc9285-011d-469e-99ba-f6ec478f4019","Type":"ContainerStarted","Data":"80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9"}
Sep 10 22:45:00.621564 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.621535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v" event={"ID":"c6873956-fa0d-4883-801a-fb657d6cb640","Type":"ContainerStarted","Data":"951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3"}
Sep 10 22:45:00.622724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.622693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r" event={"ID":"916d260b-3f10-455f-814f-cc52c285deed","Type":"ContainerStarted","Data":"5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c"}
Sep 10 22:45:00.623804 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:00.623784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt" event={"ID":"6ee9714f-37b0-4cc0-b385-b527bb773ae9","Type":"ContainerStarted","Data":"f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374"}
Sep 10 22:45:01.631075 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.631042    2559 generic.go:356] "Generic (PLEG): container finished" podID="0cbc9285-011d-469e-99ba-f6ec478f4019" containerID="8f3dc07ae4f752def0f9eb5d05ca404cd9595b7f2e4369f20f6d49e4d3b63e84" exitCode=0
Sep 10 22:45:01.631570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.631133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr" event={"ID":"0cbc9285-011d-469e-99ba-f6ec478f4019","Type":"ContainerDied","Data":"8f3dc07ae4f752def0f9eb5d05ca404cd9595b7f2e4369f20f6d49e4d3b63e84"}
Sep 10 22:45:01.632744 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.632716    2559 generic.go:356] "Generic (PLEG): container finished" podID="c6873956-fa0d-4883-801a-fb657d6cb640" containerID="89dff596cefce25602961e1833992abb2a9e14de1d954eed614d96fa8fbd2fef" exitCode=0
Sep 10 22:45:01.632857 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.632772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v" event={"ID":"c6873956-fa0d-4883-801a-fb657d6cb640","Type":"ContainerDied","Data":"89dff596cefce25602961e1833992abb2a9e14de1d954eed614d96fa8fbd2fef"}
Sep 10 22:45:01.634285 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.634265    2559 generic.go:356] "Generic (PLEG): container finished" podID="916d260b-3f10-455f-814f-cc52c285deed" containerID="fb6129ec0b207f48d478fbe243bdb28760d24ea69fb876d79c922dfd9174ba47" exitCode=0
Sep 10 22:45:01.634395 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.634329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r" event={"ID":"916d260b-3f10-455f-814f-cc52c285deed","Type":"ContainerDied","Data":"fb6129ec0b207f48d478fbe243bdb28760d24ea69fb876d79c922dfd9174ba47"}
Sep 10 22:45:01.635856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.635837    2559 generic.go:356] "Generic (PLEG): container finished" podID="6ee9714f-37b0-4cc0-b385-b527bb773ae9" containerID="abaee4ff97feefba72a1c74f1bfdeaab6ae204e6b4e7340e062378050f3e886b" exitCode=0
Sep 10 22:45:01.635946 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:01.635864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt" event={"ID":"6ee9714f-37b0-4cc0-b385-b527bb773ae9","Type":"ContainerDied","Data":"abaee4ff97feefba72a1c74f1bfdeaab6ae204e6b4e7340e062378050f3e886b"}
Sep 10 22:45:02.821938 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:02.821907    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"
Sep 10 22:45:02.832786 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:02.832751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"
Sep 10 22:45:02.869550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:02.869501    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"
Sep 10 22:45:02.872833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:02.872807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"
Sep 10 22:45:03.647363 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.647328    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"
Sep 10 22:45:03.647583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.647327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r" event={"ID":"916d260b-3f10-455f-814f-cc52c285deed","Type":"ContainerDied","Data":"5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c"}
Sep 10 22:45:03.647583 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.647457    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bb17c1cac91d2fee2327b8ade2c8d556546ee43d8903116e88e231f3a27890c"
Sep 10 22:45:03.648967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.648943    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"
Sep 10 22:45:03.649093 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.648981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt" event={"ID":"6ee9714f-37b0-4cc0-b385-b527bb773ae9","Type":"ContainerDied","Data":"f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374"}
Sep 10 22:45:03.649093 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.649044    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8b03bf1be8956a80244e8ae38ffcdd27a497dffddb6e0c4abbc2ff739e18374"
Sep 10 22:45:03.650570 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.650551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr"
Sep 10 22:45:03.650695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.650595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818005-xwwbr" event={"ID":"0cbc9285-011d-469e-99ba-f6ec478f4019","Type":"ContainerDied","Data":"80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9"}
Sep 10 22:45:03.650695 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.650661    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80376c941fb81afe437cf6fcb3d39fe88a1035261855278b20005844e2f3ffe9"
Sep 10 22:45:03.652020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.651996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v" event={"ID":"c6873956-fa0d-4883-801a-fb657d6cb640","Type":"ContainerDied","Data":"951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3"}
Sep 10 22:45:03.652020 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.652015    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"
Sep 10 22:45:03.652194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:03.652032    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="951a0f0e39757b6e2b713c23234f89bcd68be707b3cf977ead82d394029848b3"
Sep 10 22:45:06.918179 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:06.918086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.579277    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"]
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580188    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916d260b-3f10-455f-814f-cc52c285deed" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580209    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="916d260b-3f10-455f-814f-cc52c285deed" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580223    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee9714f-37b0-4cc0-b385-b527bb773ae9" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580232    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee9714f-37b0-4cc0-b385-b527bb773ae9" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580279    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cbc9285-011d-469e-99ba-f6ec478f4019" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580288    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cbc9285-011d-469e-99ba-f6ec478f4019" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580302    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6873956-fa0d-4883-801a-fb657d6cb640" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580317    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6873956-fa0d-4883-801a-fb657d6cb640" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580513    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="916d260b-3f10-455f-814f-cc52c285deed" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580534    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee9714f-37b0-4cc0-b385-b527bb773ae9" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580556    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6873956-fa0d-4883-801a-fb657d6cb640" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.580566    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cbc9285-011d-469e-99ba-f6ec478f4019" containerName="cleanup"
Sep 10 22:45:07.585169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.584611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:07.587758 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.587718    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:45:07.588515 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.588262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:45:07.589707 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.589683    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"]
Sep 10 22:45:07.607558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.607521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b\" (UID: \"dae718e8-d194-42c0-b8bd-485beef7b27d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:07.708720 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.708674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b\" (UID: \"dae718e8-d194-42c0-b8bd-485beef7b27d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:07.709342 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.709320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b\" (UID: \"dae718e8-d194-42c0-b8bd-485beef7b27d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:07.897717 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:07.897636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:08.171900 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:08.171822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"]
Sep 10 22:45:08.174450 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:08.174426    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae718e8_d194_42c0_b8bd_485beef7b27d.slice/crio-f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490 WatchSource:0}: Error finding container f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490: Status 404 returned error can't find the container with id f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490
Sep 10 22:45:08.681119 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:08.681078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b" event={"ID":"dae718e8-d194-42c0-b8bd-485beef7b27d","Type":"ContainerStarted","Data":"55832ef55f298546d9a56929ca6b636b47ad10c59656b8fbc35c3377298c5580"}
Sep 10 22:45:08.681337 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:08.681141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b" event={"ID":"dae718e8-d194-42c0-b8bd-485beef7b27d","Type":"ContainerStarted","Data":"f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490"}
Sep 10 22:45:08.696376 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:08.696314    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b" podStartSLOduration=1.696295692 podStartE2EDuration="1.696295692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:45:08.695606101 +0000 UTC m=+1615.279683142" watchObservedRunningTime="2026-09-10 22:45:08.696295692 +0000 UTC m=+1615.280372731"
Sep 10 22:45:09.687448 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:09.687418    2559 generic.go:356] "Generic (PLEG): container finished" podID="dae718e8-d194-42c0-b8bd-485beef7b27d" containerID="55832ef55f298546d9a56929ca6b636b47ad10c59656b8fbc35c3377298c5580" exitCode=0
Sep 10 22:45:09.687899 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:09.687514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b" event={"ID":"dae718e8-d194-42c0-b8bd-485beef7b27d","Type":"ContainerDied","Data":"55832ef55f298546d9a56929ca6b636b47ad10c59656b8fbc35c3377298c5580"}
Sep 10 22:45:10.826750 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:10.826717    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:10.832576 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:10.832552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca\") pod \"dae718e8-d194-42c0-b8bd-485beef7b27d\" (UID: \"dae718e8-d194-42c0-b8bd-485beef7b27d\") "
Sep 10 22:45:10.832924 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:10.832904    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dae718e8-d194-42c0-b8bd-485beef7b27d" (UID: "dae718e8-d194-42c0-b8bd-485beef7b27d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:10.933875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:10.933831    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae718e8-d194-42c0-b8bd-485beef7b27d-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:11.699960 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:11.699933    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"
Sep 10 22:45:11.700160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:11.699933    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b" event={"ID":"dae718e8-d194-42c0-b8bd-485beef7b27d","Type":"ContainerDied","Data":"f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490"}
Sep 10 22:45:11.700160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:11.700062    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f429bfc71119bac33be191c78c9fea31e1a2710a52483b78c58a94f4fcce1490"
Sep 10 22:45:13.522785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.522745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.578996 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.578960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.748513 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.745272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.754560 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.754514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"]
Sep 10 22:45:13.756767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.756734    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-cleanup-6b8825-29818005-fnpmt"]
Sep 10 22:45:13.776094 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.776012    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:45:13.776301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.776276    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" podUID="fa49dc84-132c-49d2-8b88-b2574d74cf96" containerName="payload-processing" containerID="cri-o://5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0" gracePeriod=30
Sep 10 22:45:13.783389 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.783359    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:45:13.784582 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.784453    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" podUID="9396a012-800f-4be4-9335-7d7f7a2eb112" containerName="payload-pre-processing" containerID="cri-o://d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670" gracePeriod=30
Sep 10 22:45:13.815866 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.815832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.876110 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.876062    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.891863 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.891836    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee9714f-37b0-4cc0-b385-b527bb773ae9" path="/var/lib/kubelet/pods/6ee9714f-37b0-4cc0-b385-b527bb773ae9/volumes"
Sep 10 22:45:13.945098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.945058    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"]
Sep 10 22:45:13.946781 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.946727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:13.947471 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:13.947441    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6b8825-r8v6b"]
Sep 10 22:45:14.013915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.013879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:14.040617 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.040550    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:45:14.064957 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.064927    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume\") pod \"fa49dc84-132c-49d2-8b88-b2574d74cf96\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") "
Sep 10 22:45:14.065111 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.064978    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4stzr\" (UniqueName: \"kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr\") pod \"fa49dc84-132c-49d2-8b88-b2574d74cf96\" (UID: \"fa49dc84-132c-49d2-8b88-b2574d74cf96\") "
Sep 10 22:45:14.065343 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.065319    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa49dc84-132c-49d2-8b88-b2574d74cf96" (UID: "fa49dc84-132c-49d2-8b88-b2574d74cf96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:14.067006 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.066980    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr" (OuterVolumeSpecName: "kube-api-access-4stzr") pod "fa49dc84-132c-49d2-8b88-b2574d74cf96" (UID: "fa49dc84-132c-49d2-8b88-b2574d74cf96"). InnerVolumeSpecName "kube-api-access-4stzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:14.072206 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.072182    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:45:14.166500 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.166464    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znn8x\" (UniqueName: \"kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x\") pod \"9396a012-800f-4be4-9335-7d7f7a2eb112\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") "
Sep 10 22:45:14.166712 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.166622    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume\") pod \"9396a012-800f-4be4-9335-7d7f7a2eb112\" (UID: \"9396a012-800f-4be4-9335-7d7f7a2eb112\") "
Sep 10 22:45:14.166793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.166767    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa49dc84-132c-49d2-8b88-b2574d74cf96-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.166793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.166780    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4stzr\" (UniqueName: \"kubernetes.io/projected/fa49dc84-132c-49d2-8b88-b2574d74cf96-kube-api-access-4stzr\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.167015 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.166988    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9396a012-800f-4be4-9335-7d7f7a2eb112" (UID: "9396a012-800f-4be4-9335-7d7f7a2eb112"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:14.168732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.168707    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x" (OuterVolumeSpecName: "kube-api-access-znn8x") pod "9396a012-800f-4be4-9335-7d7f7a2eb112" (UID: "9396a012-800f-4be4-9335-7d7f7a2eb112"). InnerVolumeSpecName "kube-api-access-znn8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:14.267756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.267712    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396a012-800f-4be4-9335-7d7f7a2eb112-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.267756 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.267746    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znn8x\" (UniqueName: \"kubernetes.io/projected/9396a012-800f-4be4-9335-7d7f7a2eb112-kube-api-access-znn8x\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.310349 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.310255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:14.562991 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:14.562900    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:14.722564 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.722528    2559 generic.go:356] "Generic (PLEG): container finished" podID="9396a012-800f-4be4-9335-7d7f7a2eb112" containerID="d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670" exitCode=0
Sep 10 22:45:14.722765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.722641    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"
Sep 10 22:45:14.722765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.722660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" event={"ID":"9396a012-800f-4be4-9335-7d7f7a2eb112","Type":"ContainerDied","Data":"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"}
Sep 10 22:45:14.722765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.722703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp" event={"ID":"9396a012-800f-4be4-9335-7d7f7a2eb112","Type":"ContainerDied","Data":"6cf16b94f2e952b080efff932735abf2f8efc414a38a204237b8ad7da944feb1"}
Sep 10 22:45:14.722765 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.722731    2559 scope.go:117] "RemoveContainer" containerID="d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"
Sep 10 22:45:14.728324 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.728293    2559 generic.go:356] "Generic (PLEG): container finished" podID="fa49dc84-132c-49d2-8b88-b2574d74cf96" containerID="5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0" exitCode=0
Sep 10 22:45:14.728483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.728337    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"
Sep 10 22:45:14.728483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.728387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" event={"ID":"fa49dc84-132c-49d2-8b88-b2574d74cf96","Type":"ContainerDied","Data":"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"}
Sep 10 22:45:14.728483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.728444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk" event={"ID":"fa49dc84-132c-49d2-8b88-b2574d74cf96","Type":"ContainerDied","Data":"27d4397b72e0591364a856cff5012295f500873d886670a28c9c6f41ce1ac0d6"}
Sep 10 22:45:14.734724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.734706    2559 scope.go:117] "RemoveContainer" containerID="d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"
Sep 10 22:45:14.735040 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:14.735023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670\": container with ID starting with d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670 not found: ID does not exist" containerID="d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"
Sep 10 22:45:14.735085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.735051    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670"} err="failed to get container status \"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670\": rpc error: code = NotFound desc = could not find container \"d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670\": container with ID starting with d567873a28fbb8fba02fa24b1959acd9dfa9cbb681d823c98b9717fc5640e670 not found: ID does not exist"
Sep 10 22:45:14.735085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.735067    2559 scope.go:117] "RemoveContainer" containerID="5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"
Sep 10 22:45:14.744310 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.744289    2559 scope.go:117] "RemoveContainer" containerID="5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"
Sep 10 22:45:14.744665 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:14.744646    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0\": container with ID starting with 5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0 not found: ID does not exist" containerID="5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"
Sep 10 22:45:14.744711 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.744673    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0"} err="failed to get container status \"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0\": rpc error: code = NotFound desc = could not find container \"5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0\": container with ID starting with 5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0 not found: ID does not exist"
Sep 10 22:45:14.745118 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.745098    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:45:14.749381 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.749351    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp"]
Sep 10 22:45:14.758642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.758608    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:45:14.765901 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:14.765875    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk"]
Sep 10 22:45:15.892829 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:15.892792    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9396a012-800f-4be4-9335-7d7f7a2eb112" path="/var/lib/kubelet/pods/9396a012-800f-4be4-9335-7d7f7a2eb112/volumes"
Sep 10 22:45:15.893199 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:15.893127    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae718e8-d194-42c0-b8bd-485beef7b27d" path="/var/lib/kubelet/pods/dae718e8-d194-42c0-b8bd-485beef7b27d/volumes"
Sep 10 22:45:15.893442 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:15.893429    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa49dc84-132c-49d2-8b88-b2574d74cf96" path="/var/lib/kubelet/pods/fa49dc84-132c-49d2-8b88-b2574d74cf96/volumes"
Sep 10 22:45:17.320505 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:17.320452    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:18.544291 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:18.544252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:45:20.144747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:20.144716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:20.205732 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:20.205696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:20.408975 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:20.408880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:23.873910 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.873875    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"]
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874222    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa49dc84-132c-49d2-8b88-b2574d74cf96" containerName="payload-processing"
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874233    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa49dc84-132c-49d2-8b88-b2574d74cf96" containerName="payload-processing"
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874245    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9396a012-800f-4be4-9335-7d7f7a2eb112" containerName="payload-pre-processing"
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874250    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9396a012-800f-4be4-9335-7d7f7a2eb112" containerName="payload-pre-processing"
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874260    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae718e8-d194-42c0-b8bd-485beef7b27d" containerName="revoke-keys"
Sep 10 22:45:23.874309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874265    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae718e8-d194-42c0-b8bd-485beef7b27d" containerName="revoke-keys"
Sep 10 22:45:23.874512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874325    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa49dc84-132c-49d2-8b88-b2574d74cf96" containerName="payload-processing"
Sep 10 22:45:23.874512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874332    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9396a012-800f-4be4-9335-7d7f7a2eb112" containerName="payload-pre-processing"
Sep 10 22:45:23.874512 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.874339    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae718e8-d194-42c0-b8bd-485beef7b27d" containerName="revoke-keys"
Sep 10 22:45:23.878788 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.878765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:23.881443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.881236    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:45:23.881443 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.881290    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:45:23.884908 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.884880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"]
Sep 10 22:45:23.962482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:23.962439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr\" (UID: \"3d72b95b-9601-49a6-914d-ae6e95a62582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:24.013545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.013500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:24.064035 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.063995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr\" (UID: \"3d72b95b-9601-49a6-914d-ae6e95a62582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:24.064692 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.064671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr\" (UID: \"3d72b95b-9601-49a6-914d-ae6e95a62582\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:24.191085 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.190964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:24.466767 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.466737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"]
Sep 10 22:45:24.468673 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:45:24.468645    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d72b95b_9601_49a6_914d_ae6e95a62582.slice/crio-dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6 WatchSource:0}: Error finding container dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6: Status 404 returned error can't find the container with id dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6
Sep 10 22:45:24.786531 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.786468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr" event={"ID":"3d72b95b-9601-49a6-914d-ae6e95a62582","Type":"ContainerStarted","Data":"6d3fb39af3140be35e644142bb18da47e7d92f09580554d7c77693d9405eae2c"}
Sep 10 22:45:24.786736 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.786553    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr" event={"ID":"3d72b95b-9601-49a6-914d-ae6e95a62582","Type":"ContainerStarted","Data":"dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6"}
Sep 10 22:45:24.801634 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:24.801575    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr" podStartSLOduration=1.801557174 podStartE2EDuration="1.801557174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:45:24.80058689 +0000 UTC m=+1631.384663930" watchObservedRunningTime="2026-09-10 22:45:24.801557174 +0000 UTC m=+1631.385634246"
Sep 10 22:45:25.792997 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:25.792958    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d72b95b-9601-49a6-914d-ae6e95a62582" containerID="6d3fb39af3140be35e644142bb18da47e7d92f09580554d7c77693d9405eae2c" exitCode=0
Sep 10 22:45:25.793400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:25.793026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr" event={"ID":"3d72b95b-9601-49a6-914d-ae6e95a62582","Type":"ContainerDied","Data":"6d3fb39af3140be35e644142bb18da47e7d92f09580554d7c77693d9405eae2c"}
Sep 10 22:45:26.927195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:26.927163    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:26.991199 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:26.991165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca\") pod \"3d72b95b-9601-49a6-914d-ae6e95a62582\" (UID: \"3d72b95b-9601-49a6-914d-ae6e95a62582\") "
Sep 10 22:45:26.991599 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:26.991563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d72b95b-9601-49a6-914d-ae6e95a62582" (UID: "3d72b95b-9601-49a6-914d-ae6e95a62582"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:27.092720 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:27.092639    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d72b95b-9601-49a6-914d-ae6e95a62582-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:27.366397 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:27.366313    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:27.804462 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:27.804433    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"
Sep 10 22:45:27.804660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:27.804464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr" event={"ID":"3d72b95b-9601-49a6-914d-ae6e95a62582","Type":"ContainerDied","Data":"dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6"}
Sep 10 22:45:27.804660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:27.804522    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd295fe5af4c98f565e5c8803453d984d9675ef7dbf890df87a0f4ff0671b5c6"
Sep 10 22:45:29.521903 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:29.521860    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:37.246467 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:37.246428    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:45:37.375627 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:37.375592    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:39.421936 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.421883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:39.440554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.440518    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:45:39.440820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.440795    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" podUID="d6de3365-bba1-4915-b169-5d1a74ec8de3" containerName="payload-processing" containerID="cri-o://a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c" gracePeriod=30
Sep 10 22:45:39.447038 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.447012    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:45:39.447254 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.447230    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" podUID="79b489aa-457b-4048-907b-4bdb883bb6a4" containerName="payload-pre-processing" containerID="cri-o://7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79" gracePeriod=30
Sep 10 22:45:39.491124 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.491086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:39.557823 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.557785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:39.619718 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.619685    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"]
Sep 10 22:45:39.622835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.622806    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-16d0fd-n7xgr"]
Sep 10 22:45:39.629321 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.629290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:39.729219 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.729196    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:45:39.732007 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.731986    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:45:39.821596 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.821550    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume\") pod \"d6de3365-bba1-4915-b169-5d1a74ec8de3\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") "
Sep 10 22:45:39.821799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.821638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frrh2\" (UniqueName: \"kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2\") pod \"d6de3365-bba1-4915-b169-5d1a74ec8de3\" (UID: \"d6de3365-bba1-4915-b169-5d1a74ec8de3\") "
Sep 10 22:45:39.821799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.821675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume\") pod \"79b489aa-457b-4048-907b-4bdb883bb6a4\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") "
Sep 10 22:45:39.821799 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.821729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm4tv\" (UniqueName: \"kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv\") pod \"79b489aa-457b-4048-907b-4bdb883bb6a4\" (UID: \"79b489aa-457b-4048-907b-4bdb883bb6a4\") "
Sep 10 22:45:39.822067 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.822039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6de3365-bba1-4915-b169-5d1a74ec8de3" (UID: "d6de3365-bba1-4915-b169-5d1a74ec8de3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:39.822142 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.822113    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79b489aa-457b-4048-907b-4bdb883bb6a4" (UID: "79b489aa-457b-4048-907b-4bdb883bb6a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:39.823989 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.823958    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2" (OuterVolumeSpecName: "kube-api-access-frrh2") pod "d6de3365-bba1-4915-b169-5d1a74ec8de3" (UID: "d6de3365-bba1-4915-b169-5d1a74ec8de3"). InnerVolumeSpecName "kube-api-access-frrh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:39.823989 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.823972    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv" (OuterVolumeSpecName: "kube-api-access-mm4tv") pod "79b489aa-457b-4048-907b-4bdb883bb6a4" (UID: "79b489aa-457b-4048-907b-4bdb883bb6a4"). InnerVolumeSpecName "kube-api-access-mm4tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:39.874954 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.874920    2559 generic.go:356] "Generic (PLEG): container finished" podID="d6de3365-bba1-4915-b169-5d1a74ec8de3" containerID="a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c" exitCode=0
Sep 10 22:45:39.875158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.874974    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"
Sep 10 22:45:39.875158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.875013    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" event={"ID":"d6de3365-bba1-4915-b169-5d1a74ec8de3","Type":"ContainerDied","Data":"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"}
Sep 10 22:45:39.875158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.875091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf" event={"ID":"d6de3365-bba1-4915-b169-5d1a74ec8de3","Type":"ContainerDied","Data":"3a0adf87e21d9833298b7b1264e3a1f2032ea16f286dd3896e8054348656359a"}
Sep 10 22:45:39.875158 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.875113    2559 scope.go:117] "RemoveContainer" containerID="a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"
Sep 10 22:45:39.876544 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.876522    2559 generic.go:356] "Generic (PLEG): container finished" podID="79b489aa-457b-4048-907b-4bdb883bb6a4" containerID="7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79" exitCode=0
Sep 10 22:45:39.876647 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.876579    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"
Sep 10 22:45:39.876710 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.876646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" event={"ID":"79b489aa-457b-4048-907b-4bdb883bb6a4","Type":"ContainerDied","Data":"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"}
Sep 10 22:45:39.876710 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.876695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws" event={"ID":"79b489aa-457b-4048-907b-4bdb883bb6a4","Type":"ContainerDied","Data":"89a0b4895108866bc3bc88c76986d26f26bea97df00b3d9b2f603a869d89564f"}
Sep 10 22:45:39.884333 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.884308    2559 scope.go:117] "RemoveContainer" containerID="a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"
Sep 10 22:45:39.884697 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:39.884672    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c\": container with ID starting with a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c not found: ID does not exist" containerID="a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"
Sep 10 22:45:39.884835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.884707    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c"} err="failed to get container status \"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c\": rpc error: code = NotFound desc = could not find container \"a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c\": container with ID starting with a1ba028adbb8193daf6f26d53a49909bf6ebcf9c2f47b2947cc7f35f857ae20c not found: ID does not exist"
Sep 10 22:45:39.884835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.884732    2559 scope.go:117] "RemoveContainer" containerID="7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"
Sep 10 22:45:39.892849 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.892825    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d72b95b-9601-49a6-914d-ae6e95a62582" path="/var/lib/kubelet/pods/3d72b95b-9601-49a6-914d-ae6e95a62582/volumes"
Sep 10 22:45:39.894340 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.894324    2559 scope.go:117] "RemoveContainer" containerID="7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"
Sep 10 22:45:39.894732 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:39.894707    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79\": container with ID starting with 7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79 not found: ID does not exist" containerID="7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"
Sep 10 22:45:39.894847 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.894745    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79"} err="failed to get container status \"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79\": rpc error: code = NotFound desc = could not find container \"7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79\": container with ID starting with 7da6d503c92f9fa66e77758ccf6a764c2a4f44d2ba61cf08b430e4920cb06a79 not found: ID does not exist"
Sep 10 22:45:39.898550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.898528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:45:39.902167 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.902145    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf"]
Sep 10 22:45:39.913400 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.913366    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:45:39.918651 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.918625    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws"]
Sep 10 22:45:39.922862 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.922842    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frrh2\" (UniqueName: \"kubernetes.io/projected/d6de3365-bba1-4915-b169-5d1a74ec8de3-kube-api-access-frrh2\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.922948 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.922865    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b489aa-457b-4048-907b-4bdb883bb6a4-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.922948 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.922878    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm4tv\" (UniqueName: \"kubernetes.io/projected/79b489aa-457b-4048-907b-4bdb883bb6a4-kube-api-access-mm4tv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.922948 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.922888    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6de3365-bba1-4915-b169-5d1a74ec8de3-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.987070 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:39.986976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:41.891542 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:41.891508    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b489aa-457b-4048-907b-4bdb883bb6a4" path="/var/lib/kubelet/pods/79b489aa-457b-4048-907b-4bdb883bb6a4/volumes"
Sep 10 22:45:41.891935 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:41.891880    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6de3365-bba1-4915-b169-5d1a74ec8de3" path="/var/lib/kubelet/pods/d6de3365-bba1-4915-b169-5d1a74ec8de3/volumes"
Sep 10 22:45:44.401660 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:44.401627    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:44.537833 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:44.537798    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:44.982273 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:44.982227    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:45:45.078321 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:45.078282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:45:47.384902 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:47.384864    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:48.948594 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:45:48.948554    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:45:57.429886 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:57.429840    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:45:59.511591 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:45:59.511554    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:46:00.001418 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.001377    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" podUID="69222743-16df-42e5-bd19-aae7f26dc32d" containerName="main" containerID="cri-o://8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766" gracePeriod=45
Sep 10 22:46:00.249197 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.249169    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:46:00.297538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297467    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297510    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs4p4\" (UniqueName: \"kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297708    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home\") pod \"69222743-16df-42e5-bd19-aae7f26dc32d\" (UID: \"69222743-16df-42e5-bd19-aae7f26dc32d\") "
Sep 10 22:46:00.297820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297743    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:46:00.297820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297757    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache" (OuterVolumeSpecName: "model-cache") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:46:00.298079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297945    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home" (OuterVolumeSpecName: "home") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:46:00.298079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297956    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-model-cache\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.298079 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.297987    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-tmp-dir\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.299793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.299765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm" (OuterVolumeSpecName: "dshm") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:46:00.299917 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.299837    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4" (OuterVolumeSpecName: "kube-api-access-xs4p4") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "kube-api-access-xs4p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:46:00.299970 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.299917    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69222743-16df-42e5-bd19-aae7f26dc32d" (UID: "69222743-16df-42e5-bd19-aae7f26dc32d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:46:00.398669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.398629    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs4p4\" (UniqueName: \"kubernetes.io/projected/69222743-16df-42e5-bd19-aae7f26dc32d-kube-api-access-xs4p4\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.398669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.398664    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69222743-16df-42e5-bd19-aae7f26dc32d-tls-certs\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.398669 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.398678    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-home\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.398909 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.398689    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69222743-16df-42e5-bd19-aae7f26dc32d-dshm\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:00.987816 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.987781    2559 generic.go:356] "Generic (PLEG): container finished" podID="69222743-16df-42e5-bd19-aae7f26dc32d" containerID="8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766" exitCode=0
Sep 10 22:46:00.988217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.987829    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"
Sep 10 22:46:00.988217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.987870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" event={"ID":"69222743-16df-42e5-bd19-aae7f26dc32d","Type":"ContainerDied","Data":"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"}
Sep 10 22:46:00.988217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.987912    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m" event={"ID":"69222743-16df-42e5-bd19-aae7f26dc32d","Type":"ContainerDied","Data":"b186b5425cb9ee67d848c9cb35c0f6bf5f822e4c142b28db7f42fccca21c584e"}
Sep 10 22:46:00.988217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.987929    2559 scope.go:117] "RemoveContainer" containerID="8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"
Sep 10 22:46:00.997132 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.997109    2559 scope.go:117] "RemoveContainer" containerID="8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"
Sep 10 22:46:00.997393 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:46:00.997376    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766\": container with ID starting with 8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766 not found: ID does not exist" containerID="8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"
Sep 10 22:46:00.997440 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:00.997402    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766"} err="failed to get container status \"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766\": rpc error: code = NotFound desc = could not find container \"8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766\": container with ID starting with 8dc9c240ac6f8c294c90a24d25c561da97d3ecc8e34e9e498788eafaa0597766 not found: ID does not exist"
Sep 10 22:46:01.009122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:01.009094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:46:01.014789 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:01.014766    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-16d0fd/ipp-route-16d0fd-kserve-6f45f685d7-7x74m"]
Sep 10 22:46:01.892034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:01.891999    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69222743-16df-42e5-bd19-aae7f26dc32d" path="/var/lib/kubelet/pods/69222743-16df-42e5-bd19-aae7f26dc32d/volumes"
Sep 10 22:46:03.710973 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:46:03.710930    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:46:03.711422 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:46:03.711070    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:46:07.440769 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:46:07.440723    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49dc84_132c_49d2_8b88_b2574d74cf96.slice/crio-5217a1018fd5cd28e291f6283bc124b0cafec5a878fa37fb84f467c542c4b2d0.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 22:46:13.230554 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:13.230521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:21.204384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:21.204341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:22.314083 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:22.314046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:27.929229 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:27.929190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:33.704369 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:33.704336    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:33.769800 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:33.769759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:33.974904 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:33.974824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:34.326284 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326203    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"]
Sep 10 22:46:34.326549 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326536    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d72b95b-9601-49a6-914d-ae6e95a62582" containerName="revoke-keys"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326550    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d72b95b-9601-49a6-914d-ae6e95a62582" containerName="revoke-keys"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326562    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69222743-16df-42e5-bd19-aae7f26dc32d" containerName="main"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326568    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="69222743-16df-42e5-bd19-aae7f26dc32d" containerName="main"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326580    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b489aa-457b-4048-907b-4bdb883bb6a4" containerName="payload-pre-processing"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326586    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b489aa-457b-4048-907b-4bdb883bb6a4" containerName="payload-pre-processing"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326596    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6de3365-bba1-4915-b169-5d1a74ec8de3" containerName="payload-processing"
Sep 10 22:46:34.326632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326602    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6de3365-bba1-4915-b169-5d1a74ec8de3" containerName="payload-processing"
Sep 10 22:46:34.326890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326658    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="69222743-16df-42e5-bd19-aae7f26dc32d" containerName="main"
Sep 10 22:46:34.326890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326668    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6de3365-bba1-4915-b169-5d1a74ec8de3" containerName="payload-processing"
Sep 10 22:46:34.326890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326679    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b489aa-457b-4048-907b-4bdb883bb6a4" containerName="payload-pre-processing"
Sep 10 22:46:34.326890 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.326690    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d72b95b-9601-49a6-914d-ae6e95a62582" containerName="revoke-keys"
Sep 10 22:46:34.328785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.328770    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:34.331305 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.331278    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:46:34.331642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.331620    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:46:34.338346 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.338323    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"]
Sep 10 22:46:34.475820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.475777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:34.495820 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.495784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk\" (UID: \"da72f7ea-a195-48e5-b119-e7b5a47905c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:34.596287 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.596195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk\" (UID: \"da72f7ea-a195-48e5-b119-e7b5a47905c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:34.596840 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.596819    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk\" (UID: \"da72f7ea-a195-48e5-b119-e7b5a47905c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:34.640248 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.640225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:34.909566 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:34.909439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"]
Sep 10 22:46:34.911884 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:46:34.911851    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda72f7ea_a195_48e5_b119_e7b5a47905c2.slice/crio-30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0 WatchSource:0}: Error finding container 30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0: Status 404 returned error can't find the container with id 30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0
Sep 10 22:46:35.168901 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:35.168874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk" event={"ID":"da72f7ea-a195-48e5-b119-e7b5a47905c2","Type":"ContainerStarted","Data":"30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0"}
Sep 10 22:46:36.175188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:36.175099    2559 generic.go:356] "Generic (PLEG): container finished" podID="da72f7ea-a195-48e5-b119-e7b5a47905c2" containerID="d25e6be3923fa35e8d53b49a31ae7cf75fde61da3044ece082a789de550c1f46" exitCode=0
Sep 10 22:46:36.175188 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:36.175148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk" event={"ID":"da72f7ea-a195-48e5-b119-e7b5a47905c2","Type":"ContainerDied","Data":"d25e6be3923fa35e8d53b49a31ae7cf75fde61da3044ece082a789de550c1f46"}
Sep 10 22:46:37.306050 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:37.306023    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:37.428416 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:37.428385    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca\") pod \"da72f7ea-a195-48e5-b119-e7b5a47905c2\" (UID: \"da72f7ea-a195-48e5-b119-e7b5a47905c2\") "
Sep 10 22:46:37.428757 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:37.428733    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da72f7ea-a195-48e5-b119-e7b5a47905c2" (UID: "da72f7ea-a195-48e5-b119-e7b5a47905c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:46:37.529635 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:37.529599    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da72f7ea-a195-48e5-b119-e7b5a47905c2-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:38.186034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:38.185950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk" event={"ID":"da72f7ea-a195-48e5-b119-e7b5a47905c2","Type":"ContainerDied","Data":"30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0"}
Sep 10 22:46:38.186034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:38.185980    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"
Sep 10 22:46:38.186034 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:38.185996    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30fbf7b08e52fdaa802b0dab97b74502c7bcd56561ffd789da36d85288d7fcf0"
Sep 10 22:46:44.888243 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.888202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:44.890074 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.890052    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"]
Sep 10 22:46:44.892350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.892324    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-d28770-29818005-vgj7v"]
Sep 10 22:46:44.910536 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.910481    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:46:44.910801 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.910755    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" podUID="95d6f639-9acd-499a-aa60-56da66848c02" containerName="payload-processing" containerID="cri-o://9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192" gracePeriod=30
Sep 10 22:46:44.988261 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:44.988214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:45.087598 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.087563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:45.102068 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.102039    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"]
Sep 10 22:46:45.105016 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.104983    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d28770-l4qzk"]
Sep 10 22:46:45.167122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.167095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:46:45.187194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.187157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume\") pod \"95d6f639-9acd-499a-aa60-56da66848c02\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") "
Sep 10 22:46:45.187194 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.187201    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g92zv\" (UniqueName: \"kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv\") pod \"95d6f639-9acd-499a-aa60-56da66848c02\" (UID: \"95d6f639-9acd-499a-aa60-56da66848c02\") "
Sep 10 22:46:45.187939 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.187910    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95d6f639-9acd-499a-aa60-56da66848c02" (UID: "95d6f639-9acd-499a-aa60-56da66848c02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:46:45.188407 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.188378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:45.189860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.189838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv" (OuterVolumeSpecName: "kube-api-access-g92zv") pod "95d6f639-9acd-499a-aa60-56da66848c02" (UID: "95d6f639-9acd-499a-aa60-56da66848c02"). InnerVolumeSpecName "kube-api-access-g92zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:46:45.220321 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.220289    2559 generic.go:356] "Generic (PLEG): container finished" podID="95d6f639-9acd-499a-aa60-56da66848c02" containerID="9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192" exitCode=0
Sep 10 22:46:45.220520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.220331    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"
Sep 10 22:46:45.220520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.220379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" event={"ID":"95d6f639-9acd-499a-aa60-56da66848c02","Type":"ContainerDied","Data":"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"}
Sep 10 22:46:45.220520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.220430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb" event={"ID":"95d6f639-9acd-499a-aa60-56da66848c02","Type":"ContainerDied","Data":"605c1cb4c854b7af6abc5de96f6d2b943470851d4c421441ccb4791c487438b8"}
Sep 10 22:46:45.220520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.220454    2559 scope.go:117] "RemoveContainer" containerID="9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"
Sep 10 22:46:45.230705 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.230686    2559 scope.go:117] "RemoveContainer" containerID="9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"
Sep 10 22:46:45.231022 ip-10-0-132-64 kubenswrapper[2559]: E0910 22:46:45.231003    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192\": container with ID starting with 9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192 not found: ID does not exist" containerID="9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"
Sep 10 22:46:45.231069 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.231030    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192"} err="failed to get container status \"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192\": rpc error: code = NotFound desc = could not find container \"9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192\": container with ID starting with 9157481d58e081d2a7df644a000dd62a4a5d6370dc8d78b65682ba3afa9ea192 not found: ID does not exist"
Sep 10 22:46:45.245309 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.245272    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:46:45.250264 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.250233    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb"]
Sep 10 22:46:45.288673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.288641    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d6f639-9acd-499a-aa60-56da66848c02-plugins-config-volume\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:45.288673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.288668    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g92zv\" (UniqueName: \"kubernetes.io/projected/95d6f639-9acd-499a-aa60-56da66848c02-kube-api-access-g92zv\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:45.478307 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.478264    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:45.891060 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.890978    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d6f639-9acd-499a-aa60-56da66848c02" path="/var/lib/kubelet/pods/95d6f639-9acd-499a-aa60-56da66848c02/volumes"
Sep 10 22:46:45.891419 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.891269    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6873956-fa0d-4883-801a-fb657d6cb640" path="/var/lib/kubelet/pods/c6873956-fa0d-4883-801a-fb657d6cb640/volumes"
Sep 10 22:46:45.891550 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:45.891537    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da72f7ea-a195-48e5-b119-e7b5a47905c2" path="/var/lib/kubelet/pods/da72f7ea-a195-48e5-b119-e7b5a47905c2/volumes"
Sep 10 22:46:48.147568 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:48.147532    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:46:49.523689 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:49.523647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:51.467114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:51.467079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:51.546367 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:51.546334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:51.744881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:51.744777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:52.074343 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074247    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"]
Sep 10 22:46:52.074715 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074694    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d6f639-9acd-499a-aa60-56da66848c02" containerName="payload-processing"
Sep 10 22:46:52.074821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074716    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d6f639-9acd-499a-aa60-56da66848c02" containerName="payload-processing"
Sep 10 22:46:52.074821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074748    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da72f7ea-a195-48e5-b119-e7b5a47905c2" containerName="revoke-keys"
Sep 10 22:46:52.074821 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074756    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="da72f7ea-a195-48e5-b119-e7b5a47905c2" containerName="revoke-keys"
Sep 10 22:46:52.074974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074849    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="da72f7ea-a195-48e5-b119-e7b5a47905c2" containerName="revoke-keys"
Sep 10 22:46:52.074974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.074864    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d6f639-9acd-499a-aa60-56da66848c02" containerName="payload-processing"
Sep 10 22:46:52.078177 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.078153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:52.080538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.080513    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:46:52.080681 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.080513    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:46:52.084590 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.084562    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"]
Sep 10 22:46:52.147210 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.147170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7\" (UID: \"dd02c607-d3da-4af6-9191-f9c7ab9aa727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:52.200787 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.200735    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:46:52.248134 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.248098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7\" (UID: \"dd02c607-d3da-4af6-9191-f9c7ab9aa727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:52.248777 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.248759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7\" (UID: \"dd02c607-d3da-4af6-9191-f9c7ab9aa727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:52.390565 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.390449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:52.664831 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:52.664754    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"]
Sep 10 22:46:52.668319 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:46:52.668287    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd02c607_d3da_4af6_9191_f9c7ab9aa727.slice/crio-ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85 WatchSource:0}: Error finding container ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85: Status 404 returned error can't find the container with id ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85
Sep 10 22:46:53.268844 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:53.268794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7" event={"ID":"dd02c607-d3da-4af6-9191-f9c7ab9aa727","Type":"ContainerStarted","Data":"9834a00923af0854260491f20102ec5c5c1e233f8afc2f433d3c6c6bc6092cb1"}
Sep 10 22:46:53.269033 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:53.268916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7" event={"ID":"dd02c607-d3da-4af6-9191-f9c7ab9aa727","Type":"ContainerStarted","Data":"ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85"}
Sep 10 22:46:53.284161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:53.284104    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7" podStartSLOduration=1.284088398 podStartE2EDuration="1.284088398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:46:53.282663336 +0000 UTC m=+1719.866740376" watchObservedRunningTime="2026-09-10 22:46:53.284088398 +0000 UTC m=+1719.868165434"
Sep 10 22:46:54.275411 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:54.275376    2559 generic.go:356] "Generic (PLEG): container finished" podID="dd02c607-d3da-4af6-9191-f9c7ab9aa727" containerID="9834a00923af0854260491f20102ec5c5c1e233f8afc2f433d3c6c6bc6092cb1" exitCode=0
Sep 10 22:46:54.275856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:54.275466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7" event={"ID":"dd02c607-d3da-4af6-9191-f9c7ab9aa727","Type":"ContainerDied","Data":"9834a00923af0854260491f20102ec5c5c1e233f8afc2f433d3c6c6bc6092cb1"}
Sep 10 22:46:55.405611 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:55.405582    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:55.477791 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:55.477750    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca\") pod \"dd02c607-d3da-4af6-9191-f9c7ab9aa727\" (UID: \"dd02c607-d3da-4af6-9191-f9c7ab9aa727\") "
Sep 10 22:46:55.478160 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:55.478135    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dd02c607-d3da-4af6-9191-f9c7ab9aa727" (UID: "dd02c607-d3da-4af6-9191-f9c7ab9aa727"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:46:55.578802 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:55.578709    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd02c607-d3da-4af6-9191-f9c7ab9aa727-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:46:56.286855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:56.286823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7" event={"ID":"dd02c607-d3da-4af6-9191-f9c7ab9aa727","Type":"ContainerDied","Data":"ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85"}
Sep 10 22:46:56.286855 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:56.286853    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"
Sep 10 22:46:56.287084 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:46:56.286873    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba818678d2b4bc56c34130495dd4a71fc69a0f81edbbccd9d71fee7031662a85"
Sep 10 22:47:02.582742 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.582704    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"]
Sep 10 22:47:02.587161 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.587133    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-58cd39-29818005-rrv5r"]
Sep 10 22:47:02.588876 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.588847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:02.657613 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.657566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:02.726465 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.726426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:02.787768 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.787730    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"]
Sep 10 22:47:02.790426 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.790400    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-58cd39-f5bx7"]
Sep 10 22:47:02.792897 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.792873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:02.856238 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:02.856144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:03.180752 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:03.180655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:03.895587 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:03.895555    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916d260b-3f10-455f-814f-cc52c285deed" path="/var/lib/kubelet/pods/916d260b-3f10-455f-814f-cc52c285deed/volumes"
Sep 10 22:47:03.895977 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:03.895870    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd02c607-d3da-4af6-9191-f9c7ab9aa727" path="/var/lib/kubelet/pods/dd02c607-d3da-4af6-9191-f9c7ab9aa727/volumes"
Sep 10 22:47:05.844216 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:05.844182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:47:09.204826 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.204792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:09.305557 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.305523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:09.471042 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.470963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:09.791431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.791357    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"]
Sep 10 22:47:09.791724 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.791710    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd02c607-d3da-4af6-9191-f9c7ab9aa727" containerName="revoke-keys"
Sep 10 22:47:09.791779 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.791726    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd02c607-d3da-4af6-9191-f9c7ab9aa727" containerName="revoke-keys"
Sep 10 22:47:09.791826 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.791802    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd02c607-d3da-4af6-9191-f9c7ab9aa727" containerName="revoke-keys"
Sep 10 22:47:09.795753 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.795734    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:09.798793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.798771    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:47:09.798793 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.798784    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bltkc\""
Sep 10 22:47:09.809545 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.809513    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"]
Sep 10 22:47:09.906534 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.906505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf\" (UID: \"e428a174-de5e-456a-bb9f-ab619f58fbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:09.913943 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:09.913913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:10.007769 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:10.007737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf\" (UID: \"e428a174-de5e-456a-bb9f-ab619f58fbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:10.008294 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:10.008276    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf\" (UID: \"e428a174-de5e-456a-bb9f-ab619f58fbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:10.105257 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:10.105196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:10.375815 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:10.375704    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"]
Sep 10 22:47:10.377830 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:47:10.377798    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode428a174_de5e_456a_bb9f_ab619f58fbae.slice/crio-f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b WatchSource:0}: Error finding container f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b: Status 404 returned error can't find the container with id f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b
Sep 10 22:47:11.365150 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:11.365062    2559 generic.go:356] "Generic (PLEG): container finished" podID="e428a174-de5e-456a-bb9f-ab619f58fbae" containerID="23f9cecadca87694dbccff303503016ec35b96f6fdd8f5ad7fdde402972996c6" exitCode=0
Sep 10 22:47:11.365311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:11.365151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf" event={"ID":"e428a174-de5e-456a-bb9f-ab619f58fbae","Type":"ContainerDied","Data":"23f9cecadca87694dbccff303503016ec35b96f6fdd8f5ad7fdde402972996c6"}
Sep 10 22:47:11.365311 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:11.365212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf" event={"ID":"e428a174-de5e-456a-bb9f-ab619f58fbae","Type":"ContainerStarted","Data":"f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b"}
Sep 10 22:47:12.492735 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:12.492711    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:12.630391 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:12.630324    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca\") pod \"e428a174-de5e-456a-bb9f-ab619f58fbae\" (UID: \"e428a174-de5e-456a-bb9f-ab619f58fbae\") "
Sep 10 22:47:12.630673 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:12.630653    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e428a174-de5e-456a-bb9f-ab619f58fbae" (UID: "e428a174-de5e-456a-bb9f-ab619f58fbae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:12.730792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:12.730765    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e428a174-de5e-456a-bb9f-ab619f58fbae-maas-api-service-ca\") on node \"ip-10-0-132-64.ec2.internal\" DevicePath \"\""
Sep 10 22:47:13.375804 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:13.375757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf" event={"ID":"e428a174-de5e-456a-bb9f-ab619f58fbae","Type":"ContainerDied","Data":"f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b"}
Sep 10 22:47:13.375804 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:13.375796    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"
Sep 10 22:47:13.375995 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:13.375822    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f146a9c64beea01f75e7780c012db3a168cc1b9525c628bee1a9514c0cb42c9b"
Sep 10 22:47:14.209271 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:14.209240    2559 scope.go:117] "RemoveContainer" containerID="9c1f09aef7a621203880f0ad5e7d4066a622ffdf461250a26960fa19e92e3b5d"
Sep 10 22:47:20.266429 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.266389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:20.366122 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.366089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:20.465057 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.465020    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"]
Sep 10 22:47:20.470632 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.470603    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-33b4cf-wblzf"]
Sep 10 22:47:20.472998 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.472959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:20.568230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.568135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:20.838976 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:20.838858    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:21.891484 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:21.891446    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e428a174-de5e-456a-bb9f-ab619f58fbae" path="/var/lib/kubelet/pods/e428a174-de5e-456a-bb9f-ab619f58fbae/volumes"
Sep 10 22:47:23.150155 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:23.150119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:47:26.919157 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:26.919126    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:26.984283 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:26.984235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:27.189860 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:27.189775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:47:31.356893 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:47:31.356857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:48:14.236092 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:14.236059    2559 scope.go:117] "RemoveContainer" containerID="8fbdaaa8e35bcbff59ae4dbd93dc6b531f4a87e812339dd511ac140478be681d"
Sep 10 22:48:14.244483 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:14.244463    2559 scope.go:117] "RemoveContainer" containerID="1b94b0131a7d7b26bf8a33e13175b1c02612aaa839e8ceb80cb65c0375d0e2bb"
Sep 10 22:48:14.252115 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:14.252092    2559 scope.go:117] "RemoveContainer" containerID="efc40f8090f4e44feccae88a3f10add52383f46e846ba922b47242f703522cb0"
Sep 10 22:48:51.737608 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:51.737560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:48:52.754999 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:52.754961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:48:53.215382 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:53.215346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:48:54.060463 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:48:54.060423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:49:18.447037 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:49:18.446999    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:49:27.847274 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:49:27.847233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:49:35.350665 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:49:35.350629    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:49:43.550814 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:49:43.550727    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:49:57.641604 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:49:57.641565    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:50:07.746851 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:50:07.746811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:51:14.292809 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:14.292733    2559 scope.go:117] "RemoveContainer" containerID="55832ef55f298546d9a56929ca6b636b47ad10c59656b8fbc35c3377298c5580"
Sep 10 22:51:14.301417 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:14.301396    2559 scope.go:117] "RemoveContainer" containerID="abaee4ff97feefba72a1c74f1bfdeaab6ae204e6b4e7340e062378050f3e886b"
Sep 10 22:51:14.310642 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:14.310621    2559 scope.go:117] "RemoveContainer" containerID="fb6129ec0b207f48d478fbe243bdb28760d24ea69fb876d79c922dfd9174ba47"
Sep 10 22:51:14.318114 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:14.318096    2559 scope.go:117] "RemoveContainer" containerID="89dff596cefce25602961e1833992abb2a9e14de1d954eed614d96fa8fbd2fef"
Sep 10 22:51:31.806743 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:31.806701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:51:31.858833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:31.858797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:51:37.848561 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:37.848525    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:51:46.344667 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:46.344629    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:51:54.843747 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:54.843708    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:51:56.067165 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:51:56.067126    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:52:03.939929 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:03.939891    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:04.798835 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:04.798800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:52:05.971967 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:05.971933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:52:14.346222 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:14.346192    2559 scope.go:117] "RemoveContainer" containerID="6d3fb39af3140be35e644142bb18da47e7d92f09580554d7c77693d9405eae2c"
Sep 10 22:52:15.361256 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:15.361220    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:23.511301 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:23.511265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:52:25.158587 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:25.158538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:52:25.542647 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:25.542615    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:34.758905 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:34.758863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:43.940827 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:43.940744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:51.460237 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:51.460204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:52:58.640572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:52:58.640537    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:53:04.445942 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:04.445911    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:53:10.580456 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:10.580417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cbw79"]
Sep 10 22:53:14.363243 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:14.363215    2559 scope.go:117] "RemoveContainer" containerID="d25e6be3923fa35e8d53b49a31ae7cf75fde61da3044ece082a789de550c1f46"
Sep 10 22:53:14.371190 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:14.371172    2559 scope.go:117] "RemoveContainer" containerID="23f9cecadca87694dbccff303503016ec35b96f6fdd8f5ad7fdde402972996c6"
Sep 10 22:53:14.378169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:14.378154    2559 scope.go:117] "RemoveContainer" containerID="9834a00923af0854260491f20102ec5c5c1e233f8afc2f433d3c6c6bc6092cb1"
Sep 10 22:53:19.683169 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:19.683137    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-lf9h5_bbef61e3-a102-49a1-b075-bb8d8dbcfda2/copy-manifests/0.log"
Sep 10 22:53:19.689742 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:19.689717    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-lf9h5_bbef61e3-a102-49a1-b075-bb8d8dbcfda2/manager/0.log"
Sep 10 22:53:20.476871 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:20.476838    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818005-xwwbr_0cbc9285-011d-469e-99ba-f6ec478f4019/cleanup/0.log"
Sep 10 22:53:21.663915 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:21.663888    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rxr9x_9a7de729-ae34-44f8-8ca8-d9396321e379/kuadrant-console-plugin/0.log"
Sep 10 22:53:21.893152 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:21.893123    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-cbw79_b6f37440-2fc0-4833-99a2-09ca025922cd/limitador/0.log"
Sep 10 22:53:22.557832 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:22.557798    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc6bbcb5-89gwd_9deba328-11d2-4c9e-a9f0-e86dc19e367a/kube-auth-proxy/0.log"
Sep 10 22:53:23.686792 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:23.686759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-45kx7_d1bbaa97-94f6-4629-b181-2d7f868ae6c2/main/0.log"
Sep 10 22:53:23.798567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:23.798531    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t2qlv_a13c67ef-8b44-46a7-b387-ecf887a18882/main/0.log"
Sep 10 22:53:23.908230 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:23.908190    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnp2zj_ad193d1e-fdf5-403b-82d7-a70ee4771ae5/main/0.log"
Sep 10 22:53:24.018664 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:24.018633    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-946q4_e34803d9-c1b7-4a97-80a8-ae40e34189b3/main/0.log"
Sep 10 22:53:24.127335 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:24.127301    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-c5sxx_341b2533-b8fe-4e64-8c1e-38e02930418f/main/0.log"
Sep 10 22:53:29.313723 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.313692    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fx2/must-gather-ctzsb"]
Sep 10 22:53:29.314110 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.314008    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e428a174-de5e-456a-bb9f-ab619f58fbae" containerName="revoke-keys"
Sep 10 22:53:29.314110 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.314018    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e428a174-de5e-456a-bb9f-ab619f58fbae" containerName="revoke-keys"
Sep 10 22:53:29.314110 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.314080    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e428a174-de5e-456a-bb9f-ab619f58fbae" containerName="revoke-keys"
Sep 10 22:53:29.317017 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.317002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.320063 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.320041    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fx2\"/\"openshift-service-ca.crt\""
Sep 10 22:53:29.320174 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.320113    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fx2\"/\"kube-root-ca.crt\""
Sep 10 22:53:29.320482 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.320466    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6fx2\"/\"default-dockercfg-bc8jm\""
Sep 10 22:53:29.327575 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.327551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/must-gather-ctzsb"]
Sep 10 22:53:29.330798 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.330774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:53:29.404027 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.404003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log" limit=1024
Sep 10 22:53:29.467520 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.467478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nsg\" (UniqueName: \"kubernetes.io/projected/d8858ce1-ac3a-476c-9f7e-fee37924825b-kube-api-access-z2nsg\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.467612 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.467592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8858ce1-ac3a-476c-9f7e-fee37924825b-must-gather-output\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.568054 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.567994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nsg\" (UniqueName: \"kubernetes.io/projected/d8858ce1-ac3a-476c-9f7e-fee37924825b-kube-api-access-z2nsg\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.568054 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.568045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8858ce1-ac3a-476c-9f7e-fee37924825b-must-gather-output\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.568328 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.568311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8858ce1-ac3a-476c-9f7e-fee37924825b-must-gather-output\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.576025 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.576003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nsg\" (UniqueName: \"kubernetes.io/projected/d8858ce1-ac3a-476c-9f7e-fee37924825b-kube-api-access-z2nsg\") pod \"must-gather-ctzsb\" (UID: \"d8858ce1-ac3a-476c-9f7e-fee37924825b\") " pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.625817 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.625786    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/must-gather-ctzsb"
Sep 10 22:53:29.900257 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.900235    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/must-gather-ctzsb"]
Sep 10 22:53:29.902210 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:53:29.902186    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8858ce1_ac3a_476c_9f7e_fee37924825b.slice/crio-fc0840cd1b59d4d598be42d0e67acd84d50bc3ff8a5961e6690263d5d88f7e5d WatchSource:0}: Error finding container fc0840cd1b59d4d598be42d0e67acd84d50bc3ff8a5961e6690263d5d88f7e5d: Status 404 returned error can't find the container with id fc0840cd1b59d4d598be42d0e67acd84d50bc3ff8a5961e6690263d5d88f7e5d
Sep 10 22:53:29.904027 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:29.904009    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:53:30.198115 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:30.198040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/must-gather-ctzsb" event={"ID":"d8858ce1-ac3a-476c-9f7e-fee37924825b","Type":"ContainerStarted","Data":"fc0840cd1b59d4d598be42d0e67acd84d50bc3ff8a5961e6690263d5d88f7e5d"}
Sep 10 22:53:31.206875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:31.206827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/must-gather-ctzsb" event={"ID":"d8858ce1-ac3a-476c-9f7e-fee37924825b","Type":"ContainerStarted","Data":"6dedeebfe8823688830a4a755eafae015ecee301bc06205077e453a0a543b275"}
Sep 10 22:53:31.206875 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:31.206881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/must-gather-ctzsb" event={"ID":"d8858ce1-ac3a-476c-9f7e-fee37924825b","Type":"ContainerStarted","Data":"92a28fe26310903363d1047e706e4fde0ff7b2f8c11cceaebc39016f681c97fa"}
Sep 10 22:53:31.223369 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:31.223320    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fx2/must-gather-ctzsb" podStartSLOduration=1.476204624 podStartE2EDuration="2.223301863s" totalImagesPullingTime="747.097239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:53:31.222534355 +0000 UTC m=+2117.806611398" watchObservedRunningTime="2026-09-10 22:53:31.223301863 +0000 UTC m=+2117.807378905"
Sep 10 22:53:32.177217 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:32.177184    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bvb2n_36d2fc78-340f-4d22-961c-8e70b440d188/global-pull-secret-syncer/0.log"
Sep 10 22:53:32.326469 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:32.326435    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9k5kd_73556dbc-5492-42c9-a631-d8eb6c50d08c/konnectivity-agent/0.log"
Sep 10 22:53:32.433806 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:32.433730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-64.ec2.internal_843de8051e5b09f0a1842ff02cf35f50/haproxy/0.log"
Sep 10 22:53:37.120538 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:37.120509    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rxr9x_9a7de729-ae34-44f8-8ca8-d9396321e379/kuadrant-console-plugin/0.log"
Sep 10 22:53:37.187903 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:37.187867    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-cbw79_b6f37440-2fc0-4833-99a2-09ca025922cd/limitador/0.log"
Sep 10 22:53:38.852195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:38.852138    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-cr8t5_4ca88908-8abd-4421-b1ff-7ca0490250ff/kube-state-metrics/0.log"
Sep 10 22:53:38.869677 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:38.869642    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-cr8t5_4ca88908-8abd-4421-b1ff-7ca0490250ff/kube-rbac-proxy-main/0.log"
Sep 10 22:53:38.892974 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:38.892923    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-cr8t5_4ca88908-8abd-4421-b1ff-7ca0490250ff/kube-rbac-proxy-self/0.log"
Sep 10 22:53:39.094381 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.094350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6cz_546c5848-3e75-4174-9aa7-0a3c17279075/node-exporter/0.log"
Sep 10 22:53:39.119155 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.119072    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6cz_546c5848-3e75-4174-9aa7-0a3c17279075/kube-rbac-proxy/0.log"
Sep 10 22:53:39.156064 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.156032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hc6cz_546c5848-3e75-4174-9aa7-0a3c17279075/init-textfile/0.log"
Sep 10 22:53:39.571960 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.571928    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-mv792_ae067254-1f0f-494c-b7ee-33760888dc6c/prometheus-operator/0.log"
Sep 10 22:53:39.589149 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.589123    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-mv792_ae067254-1f0f-494c-b7ee-33760888dc6c/kube-rbac-proxy/0.log"
Sep 10 22:53:39.613846 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:39.613816    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-k29mq_349dc314-2f58-4321-a25c-acdb4515d596/prometheus-operator-admission-webhook/0.log"
Sep 10 22:53:42.272365 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.272326    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"]
Sep 10 22:53:42.278195 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.278166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.295705 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.295672    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"]
Sep 10 22:53:42.308384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.308084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-podres\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.308384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.308192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xj8m\" (UniqueName: \"kubernetes.io/projected/4905fe7e-7d65-4b68-80f6-46caa5784d50-kube-api-access-5xj8m\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.308384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.308229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-proc\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.308384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.308266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-sys\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.308384 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.308355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-lib-modules\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409350 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xj8m\" (UniqueName: \"kubernetes.io/projected/4905fe7e-7d65-4b68-80f6-46caa5784d50-kube-api-access-5xj8m\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-proc\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-sys\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-lib-modules\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409558 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-podres\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.409785 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.409739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-podres\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.410098 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.410073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-proc\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.410165 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.410136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-sys\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.410262 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.410245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4905fe7e-7d65-4b68-80f6-46caa5784d50-lib-modules\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.420070 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.420031    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xj8m\" (UniqueName: \"kubernetes.io/projected/4905fe7e-7d65-4b68-80f6-46caa5784d50-kube-api-access-5xj8m\") pod \"perf-node-gather-daemonset-pfzlr\" (UID: \"4905fe7e-7d65-4b68-80f6-46caa5784d50\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.478053 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.478013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-cmpx8_baf88053-a688-4fe9-ae2a-a339eb146e6d/download-server/0.log"
Sep 10 22:53:42.591881 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.591798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:42.894737 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:42.894714    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"]
Sep 10 22:53:42.898014 ip-10-0-132-64 kubenswrapper[2559]: W0910 22:53:42.897989    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4905fe7e_7d65_4b68_80f6_46caa5784d50.slice/crio-04c46888fa75dde6e09267940c4b909f85523a6d2bac0053190254fc44aca3b0 WatchSource:0}: Error finding container 04c46888fa75dde6e09267940c4b909f85523a6d2bac0053190254fc44aca3b0: Status 404 returned error can't find the container with id 04c46888fa75dde6e09267940c4b909f85523a6d2bac0053190254fc44aca3b0
Sep 10 22:53:43.291055 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:43.291003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr" event={"ID":"4905fe7e-7d65-4b68-80f6-46caa5784d50","Type":"ContainerStarted","Data":"669d5a336b2387932cbe38a309632bde0a8046c869dcdbdd3ea9ea19b371a40a"}
Sep 10 22:53:43.291567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:43.291331    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:43.291567 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:43.291363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr" event={"ID":"4905fe7e-7d65-4b68-80f6-46caa5784d50","Type":"ContainerStarted","Data":"04c46888fa75dde6e09267940c4b909f85523a6d2bac0053190254fc44aca3b0"}
Sep 10 22:53:43.312303 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:43.312256    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr" podStartSLOduration=1.312238662 podStartE2EDuration="1.312238662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:53:43.311132908 +0000 UTC m=+2129.895209949" watchObservedRunningTime="2026-09-10 22:53:43.312238662 +0000 UTC m=+2129.896315702"
Sep 10 22:53:44.695597 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:44.695568    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk978_34414182-1fc7-4627-b943-95b7486bd141/dns/0.log"
Sep 10 22:53:44.721923 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:44.721886    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk978_34414182-1fc7-4627-b943-95b7486bd141/kube-rbac-proxy/0.log"
Sep 10 22:53:44.794822 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:44.794791    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gnmw7_b6a278a5-3036-4c64-a636-0752c2354cd2/dns-node-resolver/0.log"
Sep 10 22:53:45.391833 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:45.391803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-959988f94-nwq58_b6aebeac-98ed-4908-803c-fbbb48325059/registry/0.log"
Sep 10 22:53:45.473572 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:45.473533    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-swvxp_810b0ce6-ea16-4e7c-8d90-60b8d02dc7d7/node-ca/0.log"
Sep 10 22:53:46.701205 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:46.701177    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc6bbcb5-89gwd_9deba328-11d2-4c9e-a9f0-e86dc19e367a/kube-auth-proxy/0.log"
Sep 10 22:53:47.766559 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:47.766532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pt9xn_c731fea4-c4c7-492b-98b6-edda7abde3e1/serve-healthcheck-canary/0.log"
Sep 10 22:53:48.400845 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:48.400814    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxbgq_02e8353a-a0b4-4e31-9c4a-f7ec241025db/kube-rbac-proxy/0.log"
Sep 10 22:53:48.419620 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:48.419591    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxbgq_02e8353a-a0b4-4e31-9c4a-f7ec241025db/exporter/0.log"
Sep 10 22:53:48.440205 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:48.440175    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mxbgq_02e8353a-a0b4-4e31-9c4a-f7ec241025db/extractor/0.log"
Sep 10 22:53:49.309431 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:49.309385    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-pfzlr"
Sep 10 22:53:50.903761 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:50.903713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-lf9h5_bbef61e3-a102-49a1-b075-bb8d8dbcfda2/manager/0.log"
Sep 10 22:53:50.924339 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:50.924312    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-lf9h5_bbef61e3-a102-49a1-b075-bb8d8dbcfda2/copy-manifests/0.log"
Sep 10 22:53:52.485744 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:52.485711    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dbdc5d69b-fs4bp_40123329-17f5-4c1b-a91c-67068490a72f/manager/0.log"
Sep 10 22:53:52.544809 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:52.544778    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc6bbcb5-89gwd_9deba328-11d2-4c9e-a9f0-e86dc19e367a/kube-auth-proxy/0.log"
Sep 10 22:53:52.546522 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:52.546459    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q6pwb_5c176352-5522-4678-a0e1-4b5d9028dd17/openshift-lws-operator/0.log"
Sep 10 22:53:54.291540 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:54.291443    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54fc6bbcb5-89gwd_9deba328-11d2-4c9e-a9f0-e86dc19e367a/kube-auth-proxy/0.log"
Sep 10 22:53:58.741090 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.741060    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4nzqz_6dc0fe57-4546-42c2-87ba-4b26d3dc56f6/kube-multus/0.log"
Sep 10 22:53:58.767683 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.767658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/kube-multus-additional-cni-plugins/0.log"
Sep 10 22:53:58.786887 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.786858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/egress-router-binary-copy/0.log"
Sep 10 22:53:58.805856 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.805836    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/cni-plugins/0.log"
Sep 10 22:53:58.824663 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.824641    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/bond-cni-plugin/0.log"
Sep 10 22:53:58.843383 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.843358    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/routeoverride-cni/0.log"
Sep 10 22:53:58.860885 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.860864    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/whereabouts-cni-bincopy/0.log"
Sep 10 22:53:58.879208 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:58.879190    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84hxt_ccddfa35-ccf0-4c08-a2d5-3ed840100cac/whereabouts-cni/0.log"
Sep 10 22:53:59.273989 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:59.273952    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5kkst_17154967-f5fb-4eb0-b868-97d01004afcb/network-metrics-daemon/0.log"
Sep 10 22:53:59.296048 ip-10-0-132-64 kubenswrapper[2559]: I0910 22:53:59.296020    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5kkst_17154967-f5fb-4eb0-b868-97d01004afcb/kube-rbac-proxy/0.log"