Sep 11 16:02:07.620591 ip-10-0-137-9 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 16:02:08.061367 ip-10-0-137-9 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:08.061367 ip-10-0-137-9 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 16:02:08.061367 ip-10-0-137-9 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:08.061367 ip-10-0-137-9 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 16:02:08.061367 ip-10-0-137-9 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:08.065325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.065208    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070712    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070734    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070738    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070741    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070746    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.070739 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070750    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070753    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070756    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070758    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070761    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070764    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070766    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070769    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070771    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070773    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070776    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070778    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070781    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070783    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070786    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070791    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070794    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070796    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070799    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070801    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.070963 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070803    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070806    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070808    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070811    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070813    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070816    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070819    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070821    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070823    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070826    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070828    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070830    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070833    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070835    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070839    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070841    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070844    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070846    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070849    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070852    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.071480 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070855    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070857    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070860    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070862    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070865    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070867    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070870    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070872    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070875    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070879    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070883    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070886    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070889    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070892    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070895    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070898    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070902    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070905    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070908    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.071989 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070911    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070914    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070916    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070919    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070921    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070923    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070926    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070930    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070932    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070935    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070937    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070940    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070943    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070945    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070948    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070951    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070953    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070955    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070959    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070968    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.072466 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070971    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070973    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070976    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070979    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070982    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070984    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070987    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070989    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070991    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070994    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070996    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.070999    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071001    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071003    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071006    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071790    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071798    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071802    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071805    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.072946 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071809    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071812    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071815    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071818    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071821    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071824    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071826    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071829    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071831    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071834    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071836    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071839    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071841    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071851    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071854    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071856    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071859    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071862    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071864    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071866    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.073450 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071869    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071871    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071874    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071876    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071879    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071882    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071884    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071887    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071889    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071892    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071894    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071896    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071900    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071903    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071905    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071908    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071910    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071913    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071916    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071918    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.073955 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071921    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071923    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071926    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071928    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071931    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071934    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071942    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071945    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071947    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071950    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071952    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071955    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071957    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071960    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071962    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071965    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071968    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071970    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071974    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.074493 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071977    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071980    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071983    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071986    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071989    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071993    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071996    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.071999    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072002    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072004    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072007    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072009    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072012    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072014    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072018    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072020    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072023    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072026    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072029    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072032    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.074965 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072040    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072043    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072046    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072048    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072051    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072053    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072056    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072059    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072061    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072064    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072066    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072069    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072071    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072074    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072076    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072079    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072531    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072536    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072540    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072542    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.075476 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072545    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072548    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072550    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072553    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072556    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072558    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072561    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072563    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072566    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072568    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072571    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072573    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072583    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072586    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072588    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072591    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072593    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072596    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072598    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072601    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.075973 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072603    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072605    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072608    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072610    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072612    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072615    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072617    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072620    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072622    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072625    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072628    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072630    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072633    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072635    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072638    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072641    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072645    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072654    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.076470 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072658    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072661    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072664    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072667    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072670    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072672    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072675    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072683    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072685    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072688    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072690    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072693    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072695    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072698    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072700    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072703    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072705    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072708    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072711    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072713    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.076906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072715    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072718    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072721    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072723    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072727    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072729    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072732    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072734    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072736    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072739    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072741    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072744    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072746    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072748    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072751    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072753    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072756    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072758    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072760    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072762    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.077405 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072770    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072773    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072780    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072784    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072786    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072789    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072792    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072795    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072797    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072800    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072802    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072804    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072807    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072809    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072812    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072815    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.072817    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072894    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072932    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072959    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 16:02:08.077908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072964    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072969    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072972    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072977    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072982    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072985    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072988    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072991    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072994    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.072997    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073000    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073002    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073005    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073014    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073017    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073023    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073025    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073028    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073031    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073034    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073041    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073044    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073047    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 16:02:08.078406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073050    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073053    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073056    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073062    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073066    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073069    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073073    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073076    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073079    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073082    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073085    2564 flags.go:64] FLAG: --enable-server="true"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073088    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073095    2564 flags.go:64] FLAG: --event-burst="100"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073098    2564 flags.go:64] FLAG: --event-qps="50"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073101    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073104    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073107    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073111    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073114    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073116    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073119    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073122    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073125    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073133    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073136    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 16:02:08.078970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073139    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073142    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073145    2564 flags.go:64] FLAG: --feature-gates=""
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073149    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073152    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073155    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073158    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073161    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073164    2564 flags.go:64] FLAG: --help="false"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073167    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073175    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073179    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073182    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073186    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073189    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073192    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073195    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073198    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073200    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073203    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073207    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073209    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073212    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073215    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 16:02:08.079611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073218    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073221    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073224    2564 flags.go:64] FLAG: --lock-file=""
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073227    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073229    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073232    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073238    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073260    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073263    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073266    2564 flags.go:64] FLAG: --logging-format="text"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073269    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073272    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073275    2564 flags.go:64] FLAG: --manifest-url=""
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073278    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073283    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073285    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073289    2564 flags.go:64] FLAG: --max-pods="110"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073292    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073297    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073301    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073304    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073307    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073309    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073312    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073321    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 16:02:08.080206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073324    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073327    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073329    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073332    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073337    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073340    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073343    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073346    2564 flags.go:64] FLAG: --port="10250"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073349    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073352    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051527c01cd382e0e"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073355    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073358    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073361    2564 flags.go:64] FLAG: --register-node="true"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073364    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073367    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073376    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073378    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073381    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073385    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073387    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073390    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073393    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073396    2564 flags.go:64] FLAG: --runonce="false"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073399    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073402    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 16:02:08.080931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073406    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073409    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073413    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073416    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073419    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073422    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073425    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073427    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073430    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073433    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073436    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073439    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073442    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073448    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073451    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073454    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073462    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073465    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073467    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073470    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073473    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073475    2564 flags.go:64] FLAG: --v="2"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073479    2564 flags.go:64] FLAG: --version="false"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073489    2564 flags.go:64] FLAG: --vmodule=""
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073493    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 16:02:08.081560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.073496    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073643    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073647    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073650    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073653    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073656    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073659    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073663    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073665    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073669    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073671    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073674    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073677    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073679    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073682    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073684    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073687    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073689    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073692    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073694    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.082158 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073697    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073699    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073702    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073704    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073707    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073709    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073712    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073714    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073717    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073719    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073722    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073729    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073732    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073746    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073749    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073751    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073755    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073759    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073762    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073766    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.082700 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073770    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073773    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073786    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073789    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073792    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073794    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073797    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073799    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073802    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073804    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073808    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073811    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073814    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073817    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073820    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073823    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073825    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073828    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073830    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073833    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.083215 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073835    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073838    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073840    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073843    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073851    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073854    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073856    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073858    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073861    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073863    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073866    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073870    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073872    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073876    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073878    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073881    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073883    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073886    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073888    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.083735 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073891    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073893    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073896    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073898    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073901    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073903    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073906    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073909    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073911    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073913    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073916    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073919    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073921    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073924    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073926    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073929    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073931    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073935    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073944    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073947    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.084236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.073949    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.074484    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.082445    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.082464    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.082486    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.082492    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082548    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082554    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082557    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082561    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082564    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082567    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082570    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082572    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.084790 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082575    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082578    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082580    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082583    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082585    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082588    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082591    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082593    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082596    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082598    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082601    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082603    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082606    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082608    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082611    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082613    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082615    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082618    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082620    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082624    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.085142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082628    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082633    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082636    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082640    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082643    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082646    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082649    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082651    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082654    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082656    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082659    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082661    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082664    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082666    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082668    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082671    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082674    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082676    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082679    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082681    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.085657 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082684    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082686    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082689    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082691    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082694    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082696    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082699    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082701    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082704    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082706    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082709    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082712    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082715    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082718    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082722    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082724    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082727    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082729    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082733    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.086142 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082737    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082739    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082742    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082745    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082748    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082750    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082753    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082755    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082757    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082760    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082763    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082765    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082767    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082770    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082772    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082775    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082777    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082779    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082782    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082784    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.086630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082787    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082789    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082791    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082794    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082796    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082799    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082803    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082807    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082811    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082813    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082816    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082819    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.082824    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082956    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082960    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:08.087156 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082964    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082967    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082970    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082973    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082975    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082978    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082981    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082984    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082986    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082989    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082991    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082994    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.082998    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083001    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083004    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083007    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083010    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083013    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083016    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083018    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:08.087535 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083021    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083023    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083026    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083028    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083031    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083033    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083036    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083039    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083041    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083044    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083046    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083049    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083052    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083054    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083057    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083059    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083061    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083064    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083066    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083069    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:08.088013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083071    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083074    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083078    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083081    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083084    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083086    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083088    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083091    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083093    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083096    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083098    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083100    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083103    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083105    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083108    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083110    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083115    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083118    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083121    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:08.088638 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083124    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083127    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083129    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083132    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083135    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083137    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083140    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083142    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083144    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083147    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083150    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083152    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083155    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083157    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083159    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083162    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083164    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083167    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083169    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083172    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:08.089102 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083174    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083176    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083179    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083181    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083184    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083186    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083188    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083191    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083194    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083199    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083201    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083204    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083206    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083209    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083211    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083214    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083217    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:08.089598 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:08.083219    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.083224    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.083375    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.086154    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.087263    2564 server.go:1019] "Starting client certificate rotation"
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.087373    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:02:08.090009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.087407    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:02:08.090223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.090209    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:02:08.091853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.091822    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:02:08.103673 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.103531    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 11 16:02:08.107634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.107614    2564 log.go:25] "Validated CRI v1 image API"
Sep 11 16:02:08.110756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.110732    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 16:02:08.113205 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.113181    2564 fs.go:135] Filesystem UUIDs: map[5a051696-d42a-4641-abec-a6ca742b029f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a73b28b4-8e3a-4d31-8567-9c40391dcf3a:/dev/nvme0n1p4]
Sep 11 16:02:08.113332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.113203    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 16:02:08.118563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.118440    2564 manager.go:216] Machine: {Timestamp:2026-09-11 16:02:08.116924873 +0000 UTC m=+0.369441717 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102399 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2afeaed202e37c33d8bc45680b0443 SystemUUID:ec2afeae-d202-e37c-33d8-bc45680b0443 BootID:caf7c663-233f-4ab8-abe7-d6247a210c75 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:d8:bd:6e:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:d8:bd:6e:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:53:5d:a2:b3:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 16:02:08.118563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.118555    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 16:02:08.118745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.118673    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 16:02:08.122082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122051    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 16:02:08.122283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122085    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 16:02:08.122829 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122816    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 16:02:08.122882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122836    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 16:02:08.122882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122847    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:02:08.122882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.122867    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:02:08.123687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.123673    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 16:02:08.127266 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127237    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:02:08.127413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127401    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 16:02:08.127477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127447    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 16:02:08.127477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127463    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 16:02:08.127565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127483    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 16:02:08.127565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127501    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 11 16:02:08.127565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127516    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 16:02:08.127918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127904    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:02:08.127988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.127926    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:02:08.130304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.130289    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 16:02:08.132558 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.132544    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 16:02:08.132613 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.132575    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 16:02:08.134035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134013    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 16:02:08.134035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134031    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 16:02:08.134035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134037    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134053    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134067    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134075    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134089    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134094    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134100    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134106    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134121    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 16:02:08.134191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134127    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 16:02:08.134886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134875    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 16:02:08.134886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.134883    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 16:02:08.135949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.135930    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:02:08.138743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.138730    2564 server.go:1268] "Started kubelet"
Sep 11 16:02:08.138817 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.138795    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 16:02:08.142694 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.142522    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 16:02:08.142776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.142722    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 16:02:08.143320 ip-10-0-137-9 systemd[1]: Started Kubernetes Kubelet.
Sep 11 16:02:08.145486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.145466    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 16:02:08.145976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.145954    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 16:02:08.147610 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.147585    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 16:02:08.147692 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.147647    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 16:02:08.147871 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.147855    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 16:02:08.148538 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.147564    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66a406646  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.138700358 +0000 UTC m=+0.391217202,LastTimestamp:2026-09-11 16:02:08.138700358 +0000 UTC m=+0.391217202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.149213 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.149195    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 16:02:08.150455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.150438    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 16:02:08.151080 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151058    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 16:02:08.151217 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.151201    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.151695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151679    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 16:02:08.151777 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151680    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 16:02:08.151777 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151710    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 16:02:08.151843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151802    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 16:02:08.151843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.151806    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 16:02:08.153118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153103    2564 factory.go:55] Registering systemd factory
Sep 11 16:02:08.153118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153120    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 11 16:02:08.153360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153346    2564 factory.go:153] Registering CRI-O factory
Sep 11 16:02:08.153421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153365    2564 factory.go:223] Registration of the crio container factory successfully
Sep 11 16:02:08.153421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153418    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 16:02:08.153499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153433    2564 factory.go:103] Registering Raw factory
Sep 11 16:02:08.153499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.153444    2564 manager.go:1196] Started watching for new ooms in manager
Sep 11 16:02:08.153816 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.153783    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 16:02:08.153876 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.153831    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 16:02:08.154278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.154266    2564 manager.go:349] Starting recovery of all containers
Sep 11 16:02:08.159548 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.159331    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 16:02:08.164114 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.164098    2564 manager.go:354] Recovery completed
Sep 11 16:02:08.168702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.168689    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.170770 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.170746    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.170852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.170786    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.170852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.170796    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.171499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.171483    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 16:02:08.171499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.171491    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.171499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.171498    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 16:02:08.171652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.171517    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:02:08.172185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.172173    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.172234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.172196    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.172234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.172208    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.173668 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.173654    2564 policy_none.go:49] "None policy: Start"
Sep 11 16:02:08.173748 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.173671    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 16:02:08.173748 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.173681    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 16:02:08.175617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.175604    2564 policy_none.go:47] "Start"
Sep 11 16:02:08.190388 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.190308    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c29bb99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170769305 +0000 UTC m=+0.423286148,LastTimestamp:2026-09-11 16:02:08.170769305 +0000 UTC m=+0.423286148,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.203428 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.203277    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c2a1014  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170790932 +0000 UTC m=+0.423307775,LastTimestamp:2026-09-11 16:02:08.170790932 +0000 UTC m=+0.423307775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.216865    2564 manager.go:337] "Starting Device Plugin manager"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.216904    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.216914    2564 server.go:87] "Starting device plugin registration server"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.216919    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c2a343d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170800189 +0000 UTC m=+0.423317031,LastTimestamp:2026-09-11 16:02:08.170800189 +0000 UTC m=+0.423317031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.217306    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.217319    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.217440    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.217533    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.217543    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.218075    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 16:02:08.230291 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.218121    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.230705 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.230394    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-9.ec2.internal.18d44fa66c29bb99\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c29bb99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170769305 +0000 UTC m=+0.423286148,LastTimestamp:2026-09-11 16:02:08.172184921 +0000 UTC m=+0.424701763,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.239756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.239736    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xqhfn"
Sep 11 16:02:08.240058 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.239987    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-9.ec2.internal.18d44fa66c2a1014\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c2a1014  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170790932 +0000 UTC m=+0.423307775,LastTimestamp:2026-09-11 16:02:08.172203051 +0000 UTC m=+0.424719894,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.253515 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.253437    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-9.ec2.internal.18d44fa66c2a343d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-9.ec2.internal.18d44fa66c2a343d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-9.ec2.internal,UID:ip-10-0-137-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-9.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-9.ec2.internal,},FirstTimestamp:2026-09-11 16:02:08.170800189 +0000 UTC m=+0.423317031,LastTimestamp:2026-09-11 16:02:08.172212509 +0000 UTC m=+0.424729352,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-9.ec2.internal,}"
Sep 11 16:02:08.253677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.253519    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xqhfn"
Sep 11 16:02:08.289420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.289383    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 16:02:08.289581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.289451    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 16:02:08.289581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.289476    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 16:02:08.289581 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.289523    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 16:02:08.292636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.292611    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:08.318181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.318080    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.319063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.319046    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.319156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.319081    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.319156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.319096    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.319156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.319127    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.328624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.328601    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.328754 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.328631    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-9.ec2.internal\": node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.380999 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.380963    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.390051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.390013    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"]
Sep 11 16:02:08.390184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.390118    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.391916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.391898    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.392036 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.391934    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.392036 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.391958    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.394307 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.394291    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.394397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.394385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.394452 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.394417    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.395367 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395345    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.395463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395383    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.395463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395395    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.395463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395349    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.395463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395447    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.395463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.395459    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.397761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.397746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.397819 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.397772    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:08.398702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.398681    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:08.398758 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.398708    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:08.398758 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.398721    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:08.417933 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.417907    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-9.ec2.internal\" not found" node="ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.421449 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.421433    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-9.ec2.internal\" not found" node="ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.481132 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.481105    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.552806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.552776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb030d2ec200c8398616ddd90968f8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-9.ec2.internal\" (UID: \"2fb030d2ec200c8398616ddd90968f8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.552869 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.552808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.552869 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.552827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.581237 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.581175    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.653493 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.653543 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.653543 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb030d2ec200c8398616ddd90968f8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-9.ec2.internal\" (UID: \"2fb030d2ec200c8398616ddd90968f8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.653614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb030d2ec200c8398616ddd90968f8e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-9.ec2.internal\" (UID: \"2fb030d2ec200c8398616ddd90968f8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.653614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.653614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.653576    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c99070bec913754fcbe33325c0994b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal\" (UID: \"5c99070bec913754fcbe33325c0994b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.681621 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.681597    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.720790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.720752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.723935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:08.723917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:08.781949 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.781913    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.882433 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.882368    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:08.982960 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:08.982925    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:09.052053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:09.052017    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:09.083653 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:09.083619    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:09.086813 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:09.086792    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 16:02:09.086977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:09.086960    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:02:09.087017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:09.086991    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:02:09.134261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:09.134167    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:09.184669 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:09.184637    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:11.237493 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.237453    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:11.239445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.239412    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:11.239445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.239450    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:11.239629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.239462    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:11.249022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.248985    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 15:57:10 +0000 UTC" deadline="2028-03-03 16:12:57.238048931 +0000 UTC"
Sep 11 16:02:11.249022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.249018    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12936h10m45.989034126s"
Sep 11 16:02:11.274386 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:11.274349    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb030d2ec200c8398616ddd90968f8e.slice/crio-69405a06e5419c3be07722b09c6ccf01d0b063a73ed9c5ca3262a943260f3087 WatchSource:0}: Error finding container 69405a06e5419c3be07722b09c6ccf01d0b063a73ed9c5ca3262a943260f3087: Status 404 returned error can't find the container with id 69405a06e5419c3be07722b09c6ccf01d0b063a73ed9c5ca3262a943260f3087
Sep 11 16:02:11.275444 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:11.275423    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-9.ec2.internal\" not found"
Sep 11 16:02:11.280890 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.280866    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:02:11.282955 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.282906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal" event={"ID":"2fb030d2ec200c8398616ddd90968f8e","Type":"ContainerStarted","Data":"69405a06e5419c3be07722b09c6ccf01d0b063a73ed9c5ca3262a943260f3087"}
Sep 11 16:02:11.303724 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.303689    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:11.334060 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:11.334027    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c99070bec913754fcbe33325c0994b7.slice/crio-90acb90214ab09bd1f08b09694ef70d334109e913f70cb9c3bce6948885ac02b WatchSource:0}: Error finding container 90acb90214ab09bd1f08b09694ef70d334109e913f70cb9c3bce6948885ac02b: Status 404 returned error can't find the container with id 90acb90214ab09bd1f08b09694ef70d334109e913f70cb9c3bce6948885ac02b
Sep 11 16:02:11.342175 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.342153    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:11.358292 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.358267    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:02:11.359959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.359946    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal"
Sep 11 16:02:11.374261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:11.374239    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:02:12.118910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.118879    2564 apiserver.go:52] "Watching apiserver"
Sep 11 16:02:12.128904 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.128870    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 16:02:12.130335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.130285    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal","openshift-image-registry/node-ca-75zgf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal","openshift-multus/network-metrics-daemon-shknl","openshift-network-diagnostics/network-check-target-mw5w6","openshift-network-operator/iptables-alerter-4gq9z","openshift-ovn-kubernetes/ovnkube-node-wmjq2","kube-system/konnectivity-agent-9rd6q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp","openshift-cluster-node-tuning-operator/tuned-d2pdv","openshift-dns/node-resolver-vrmwc","openshift-multus/multus-8qlzm","openshift-multus/multus-additional-cni-plugins-bhv8x","kube-system/global-pull-secret-syncer-qnghp"]
Sep 11 16:02:12.133364 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.133338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.135780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.135755    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.138162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.138137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.138297 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.138225    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:12.139144 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.139113    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 16:02:12.139144 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.139135    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 16:02:12.139380 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.139364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5b5zx\""
Sep 11 16:02:12.140630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.140612    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 16:02:12.140967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.140939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.141058 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.141033    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:12.141118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141054    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.141218 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 16:02:12.141381 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdv9x\""
Sep 11 16:02:12.141445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141431    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.141675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141661    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.141785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141768    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 16:02:12.141945 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.141931    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 16:02:12.143084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.142667    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 16:02:12.143084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.142790    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.143084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.142981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 16:02:12.143272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.143258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:12.143356 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.143333    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:12.145447 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.145424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.152428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzkf\" (UniqueName: \"kubernetes.io/projected/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-kube-api-access-thzkf\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.152570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:12.152570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-kubelet\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-var-lib-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.152686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-bin\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhg6\" (UniqueName: \"kubernetes.io/projected/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-kube-api-access-fmhg6\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-slash\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-script-lib\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-kubelet-config\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovn-node-metrics-cert\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-netns\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-node-log\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-cnibin\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-systemd-units\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.152918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-ovn\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.152991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67slg\" (UniqueName: \"kubernetes.io/projected/3961737d-819b-4805-82d0-25c998cf6bc5-kube-api-access-67slg\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-systemd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-etc-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-netd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-system-cni-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-log-socket\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-config\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.153327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-env-overrides\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.153803 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.153338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-dbus\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.154313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.154249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.154313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.154273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 16:02:12.155022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.155003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz6hd\""
Sep 11 16:02:12.155242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.155218    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.155566 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.155510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.155943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.155920    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 16:02:12.157892 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.157867    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.161672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.161649    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.162181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.162166    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.162258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.162179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 16:02:12.162258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.162254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xmj6x\""
Sep 11 16:02:12.162466 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.162414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 16:02:12.162769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.162752    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mczd9\""
Sep 11 16:02:12.163510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.163492    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 16:02:12.163621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.163559    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.163621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.163594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-958xn\""
Sep 11 16:02:12.163966 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.163943    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.165117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.165097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.167534 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.167498    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.167830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.167806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.170226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.170206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.171707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.171690    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.171995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.171975    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 16:02:12.172103 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.172034    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 16:02:12.172740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.172720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6hhxw\""
Sep 11 16:02:12.172946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.172510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nn4b2\""
Sep 11 16:02:12.173477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.173456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 16:02:12.174364 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.174345    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:02:12.174878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.174858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hk6qk\""
Sep 11 16:02:12.220117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.220080    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckrnn"
Sep 11 16:02:12.228965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.228931    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckrnn"
Sep 11 16:02:12.242948 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.242916    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 16:02:12.253623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.253623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-config\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-env-overrides\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-run\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-modprobe-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-kubernetes\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-k8s-cni-cncf-io\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.253859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.253790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-conf-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.254127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.254175 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhg6\" (UniqueName: \"kubernetes.io/projected/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-kube-api-access-fmhg6\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254210 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-registration-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.254251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-device-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.254251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/411c70e3-10ef-47cf-8d15-44c55aba379f-konnectivity-ca\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.254318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-kubelet\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.254318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-slash\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-hostroot\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-env-overrides\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-node-log\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-tuned\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs9dh\" (UniqueName: \"kubernetes.io/projected/099b73e7-be9e-4899-b52e-c62664412f79-kube-api-access-gs9dh\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.254457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-cnibin\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-sys-fs\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d96f5a19-a75d-42d8-be59-dee9403bd82c-serviceca\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.254512    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-systemd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-sys\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-slash\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8797a6d-39fa-46b4-8b90-412bff41a9ff-hosts-file\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.254638    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:12.754615816 +0000 UTC m=+3.016861950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-node-log\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-cnibin\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.254708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-systemd-units\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-ovn\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67slg\" (UniqueName: \"kubernetes.io/projected/3961737d-819b-4805-82d0-25c998cf6bc5-kube-api-access-67slg\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254796    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-systemd-units\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysconfig\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-ovn\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-system-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-config\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-systemd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-etc-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.254899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-run-systemd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-system-cni-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf8tx\" (UniqueName: \"kubernetes.io/projected/a1dd799f-a66a-4013-b279-50a5feabaf65-kube-api-access-lf8tx\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3961737d-819b-4805-82d0-25c998cf6bc5-system-cni-dir\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.255184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-etc-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-log-socket\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-dbus\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzkf\" (UniqueName: \"kubernetes.io/projected/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-kube-api-access-thzkf\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5nrd\" (UniqueName: \"kubernetes.io/projected/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-kube-api-access-s5nrd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-kubelet\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-var-lib-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/411c70e3-10ef-47cf-8d15-44c55aba379f-agent-certs\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-dbus\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsl5\" (UniqueName: \"kubernetes.io/projected/d96f5a19-a75d-42d8-be59-dee9403bd82c-kube-api-access-nbsl5\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-lib-modules\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-host\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-tmp\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-multus\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-bin\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.255742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-host-slash\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-var-lib-kubelet\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-cnibin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-script-lib\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-kubelet-config\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh72n\" (UniqueName: \"kubernetes.io/projected/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-kube-api-access-qh72n\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-log-socket\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-kubelet-config\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8797a6d-39fa-46b4-8b90-412bff41a9ff-tmp-dir\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.255901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fnpk\" (UniqueName: \"kubernetes.io/projected/b8797a6d-39fa-46b4-8b90-412bff41a9ff-kube-api-access-4fnpk\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.255906    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.255969    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:12.755955643 +0000 UTC m=+3.018201764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-kubelet\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-var-lib-openvswitch\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-bin\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovn-node-metrics-cert\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-netns\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovnkube-script-lib\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-cni-binary-copy\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-iptables-alerter-script\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-socket-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d96f5a19-a75d-42d8-be59-dee9403bd82c-host\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-conf\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-bin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-multus-certs\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256759    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-etc-kubernetes\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.256970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-socket-dir-parent\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-netns\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-multus-daemon-config\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-netd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.256968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-cni-netd\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.257002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-netns\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.257034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.257107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.257190    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 16:02:12.257598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.257550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3961737d-819b-4805-82d0-25c998cf6bc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.261120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.261094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-ovn-node-metrics-cert\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.273295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.273256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhg6\" (UniqueName: \"kubernetes.io/projected/2ff4d80e-c970-4f2f-a72d-913d405ec8c4-kube-api-access-fmhg6\") pod \"ovnkube-node-wmjq2\" (UID: \"2ff4d80e-c970-4f2f-a72d-913d405ec8c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.273669 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.273645    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:12.273669 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.273671    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:12.273833 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.273683    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:12.273833 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.273760    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:12.773743841 +0000 UTC m=+3.035989973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:12.275843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.275794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67slg\" (UniqueName: \"kubernetes.io/projected/3961737d-819b-4805-82d0-25c998cf6bc5-kube-api-access-67slg\") pod \"multus-additional-cni-plugins-bhv8x\" (UID: \"3961737d-819b-4805-82d0-25c998cf6bc5\") " pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.275843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.275805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzkf\" (UniqueName: \"kubernetes.io/projected/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-kube-api-access-thzkf\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.285602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.285553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal" event={"ID":"5c99070bec913754fcbe33325c0994b7","Type":"ContainerStarted","Data":"90acb90214ab09bd1f08b09694ef70d334109e913f70cb9c3bce6948885ac02b"}
Sep 11 16:02:12.357347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-registration-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.357347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-device-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/411c70e3-10ef-47cf-8d15-44c55aba379f-konnectivity-ca\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-kubelet\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-hostroot\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-device-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-tuned\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs9dh\" (UniqueName: \"kubernetes.io/projected/099b73e7-be9e-4899-b52e-c62664412f79-kube-api-access-gs9dh\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-kubelet\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-sys-fs\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d96f5a19-a75d-42d8-be59-dee9403bd82c-serviceca\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-hostroot\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-systemd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-sys\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.357633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8797a6d-39fa-46b4-8b90-412bff41a9ff-hosts-file\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysconfig\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-system-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf8tx\" (UniqueName: \"kubernetes.io/projected/a1dd799f-a66a-4013-b279-50a5feabaf65-kube-api-access-lf8tx\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5nrd\" (UniqueName: \"kubernetes.io/projected/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-kube-api-access-s5nrd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-registration-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-sys-fs\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysconfig\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/411c70e3-10ef-47cf-8d15-44c55aba379f-agent-certs\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8797a6d-39fa-46b4-8b90-412bff41a9ff-hosts-file\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsl5\" (UniqueName: \"kubernetes.io/projected/d96f5a19-a75d-42d8-be59-dee9403bd82c-kube-api-access-nbsl5\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-lib-modules\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-host\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.357996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-system-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/411c70e3-10ef-47cf-8d15-44c55aba379f-konnectivity-ca\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.358229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-tmp\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-cni-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d96f5a19-a75d-42d8-be59-dee9403bd82c-serviceca\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-multus\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-sys\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-host-slash\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-systemd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-var-lib-kubelet\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-cnibin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-lib-modules\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-host\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-host-slash\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh72n\" (UniqueName: \"kubernetes.io/projected/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-kube-api-access-qh72n\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-multus\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-var-lib-kubelet\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8797a6d-39fa-46b4-8b90-412bff41a9ff-tmp-dir\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-cnibin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.359086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fnpk\" (UniqueName: \"kubernetes.io/projected/b8797a6d-39fa-46b4-8b90-412bff41a9ff-kube-api-access-4fnpk\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-cni-binary-copy\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-iptables-alerter-script\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-socket-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d96f5a19-a75d-42d8-be59-dee9403bd82c-host\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8797a6d-39fa-46b4-8b90-412bff41a9ff-tmp-dir\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-conf\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-bin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-multus-certs\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-etc-kubernetes\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.358993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1dd799f-a66a-4013-b279-50a5feabaf65-socket-dir\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-socket-dir-parent\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-socket-dir-parent\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-var-lib-cni-bin\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359136    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-conf\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-netns\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-multus-certs\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-multus-daemon-config\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-etc-kubernetes\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-run\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-modprobe-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-run\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-kubernetes\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d96f5a19-a75d-42d8-be59-dee9403bd82c-host\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-cni-binary-copy\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-k8s-cni-cncf-io\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-conf-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-iptables-alerter-script\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-k8s-cni-cncf-io\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-sysctl-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-host-run-netns\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.360791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-kubernetes\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-modprobe-d\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/099b73e7-be9e-4899-b52e-c62664412f79-multus-conf-dir\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.359849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/099b73e7-be9e-4899-b52e-c62664412f79-multus-daemon-config\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.360458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-etc-tuned\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.360828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/411c70e3-10ef-47cf-8d15-44c55aba379f-agent-certs\") pod \"konnectivity-agent-9rd6q\" (UID: \"411c70e3-10ef-47cf-8d15-44c55aba379f\") " pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.361756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.360965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-tmp\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.375436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.375362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsl5\" (UniqueName: \"kubernetes.io/projected/d96f5a19-a75d-42d8-be59-dee9403bd82c-kube-api-access-nbsl5\") pod \"node-ca-75zgf\" (UID: \"d96f5a19-a75d-42d8-be59-dee9403bd82c\") " pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.375903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.375878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5nrd\" (UniqueName: \"kubernetes.io/projected/c4b6b749-b75d-48b2-986a-5e0e6c73a4c3-kube-api-access-s5nrd\") pod \"tuned-d2pdv\" (UID: \"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.375970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.375954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf8tx\" (UniqueName: \"kubernetes.io/projected/a1dd799f-a66a-4013-b279-50a5feabaf65-kube-api-access-lf8tx\") pod \"aws-ebs-csi-driver-node-4h7vp\" (UID: \"a1dd799f-a66a-4013-b279-50a5feabaf65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.376386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.376358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh72n\" (UniqueName: \"kubernetes.io/projected/6a94d97e-ef59-4649-ac5a-6aa18d714cd1-kube-api-access-qh72n\") pod \"iptables-alerter-4gq9z\" (UID: \"6a94d97e-ef59-4649-ac5a-6aa18d714cd1\") " pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.376509 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.376462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs9dh\" (UniqueName: \"kubernetes.io/projected/099b73e7-be9e-4899-b52e-c62664412f79-kube-api-access-gs9dh\") pod \"multus-8qlzm\" (UID: \"099b73e7-be9e-4899-b52e-c62664412f79\") " pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.377347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.377326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fnpk\" (UniqueName: \"kubernetes.io/projected/b8797a6d-39fa-46b4-8b90-412bff41a9ff-kube-api-access-4fnpk\") pod \"node-resolver-vrmwc\" (UID: \"b8797a6d-39fa-46b4-8b90-412bff41a9ff\") " pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.450855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.450818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:12.460600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.460230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhv8x"
Sep 11 16:02:12.474194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.474162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4gq9z"
Sep 11 16:02:12.480091 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.480066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp"
Sep 11 16:02:12.488037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.487994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:12.494900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.494868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75zgf"
Sep 11 16:02:12.504213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.504188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2pdv"
Sep 11 16:02:12.511730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.511707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vrmwc"
Sep 11 16:02:12.516714 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.516690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qlzm"
Sep 11 16:02:12.560562 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.560535    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:12.761800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.761708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:12.761800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.761766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:12.762038 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.761873    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:12.762038 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.761941    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:13.761923105 +0000 UTC m=+4.024169230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:12.762038 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.761876    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:12.762038 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.762010    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:13.76199651 +0000 UTC m=+4.024242646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:12.862752 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:12.862711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:12.862935 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.862907    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:12.862935 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.862931    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:12.863029 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.862946    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:12.863029 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:12.863014    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:13.862996437 +0000 UTC m=+4.125242581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:13.232540 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.232270    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:57:12 +0000 UTC" deadline="2028-03-31 00:28:09.637294212 +0000 UTC"
Sep 11 16:02:13.232540 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.232473    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13592h25m56.404825171s"
Sep 11 16:02:13.267299 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.267271    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3961737d_819b_4805_82d0_25c998cf6bc5.slice/crio-81d2af8a02bef6c991aed3c61381d789f4fc0d12093319e7ed0538dacdbbeba2 WatchSource:0}: Error finding container 81d2af8a02bef6c991aed3c61381d789f4fc0d12093319e7ed0538dacdbbeba2: Status 404 returned error can't find the container with id 81d2af8a02bef6c991aed3c61381d789f4fc0d12093319e7ed0538dacdbbeba2
Sep 11 16:02:13.268438 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.268411    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a94d97e_ef59_4649_ac5a_6aa18d714cd1.slice/crio-f053fb08b0f112b1bc8013c874102c5c5e75c20d4c30127dfdbc4bbaeeaaf042 WatchSource:0}: Error finding container f053fb08b0f112b1bc8013c874102c5c5e75c20d4c30127dfdbc4bbaeeaaf042: Status 404 returned error can't find the container with id f053fb08b0f112b1bc8013c874102c5c5e75c20d4c30127dfdbc4bbaeeaaf042
Sep 11 16:02:13.283953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.283926    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:13.287677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.287644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4gq9z" event={"ID":"6a94d97e-ef59-4649-ac5a-6aa18d714cd1","Type":"ContainerStarted","Data":"f053fb08b0f112b1bc8013c874102c5c5e75c20d4c30127dfdbc4bbaeeaaf042"}
Sep 11 16:02:13.288835 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.288813    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2pdv" event={"ID":"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3","Type":"ContainerStarted","Data":"8b9ea882caedfd2bee40ecb35e2dbdf15b0bea0b89b428d48d253bc1efee11bc"}
Sep 11 16:02:13.289941 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.289922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerStarted","Data":"81d2af8a02bef6c991aed3c61381d789f4fc0d12093319e7ed0538dacdbbeba2"}
Sep 11 16:02:13.296906 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.296885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dd799f_a66a_4013_b279_50a5feabaf65.slice/crio-d8d1d5a0e67179418c239ff6e7fa84185b25a9e3232fd91ed7321c7985c405ce WatchSource:0}: Error finding container d8d1d5a0e67179418c239ff6e7fa84185b25a9e3232fd91ed7321c7985c405ce: Status 404 returned error can't find the container with id d8d1d5a0e67179418c239ff6e7fa84185b25a9e3232fd91ed7321c7985c405ce
Sep 11 16:02:13.297733 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.297711    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8797a6d_39fa_46b4_8b90_412bff41a9ff.slice/crio-d4a2ade7b1f792a7905ff5593eb81391b8a62c92da11a4eaa0585410ee78a772 WatchSource:0}: Error finding container d4a2ade7b1f792a7905ff5593eb81391b8a62c92da11a4eaa0585410ee78a772: Status 404 returned error can't find the container with id d4a2ade7b1f792a7905ff5593eb81391b8a62c92da11a4eaa0585410ee78a772
Sep 11 16:02:13.299350 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.299332    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96f5a19_a75d_42d8_be59_dee9403bd82c.slice/crio-1d59f8f73944a55ec74b73ac981a33204e27d1ab93be11b70104c8e661375a1e WatchSource:0}: Error finding container 1d59f8f73944a55ec74b73ac981a33204e27d1ab93be11b70104c8e661375a1e: Status 404 returned error can't find the container with id 1d59f8f73944a55ec74b73ac981a33204e27d1ab93be11b70104c8e661375a1e
Sep 11 16:02:13.299954 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.299921    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff4d80e_c970_4f2f_a72d_913d405ec8c4.slice/crio-451d3aac8f5576f052e494f279a294031c5806985ab1983157fd5d558f2071e7 WatchSource:0}: Error finding container 451d3aac8f5576f052e494f279a294031c5806985ab1983157fd5d558f2071e7: Status 404 returned error can't find the container with id 451d3aac8f5576f052e494f279a294031c5806985ab1983157fd5d558f2071e7
Sep 11 16:02:13.300724 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.300703    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411c70e3_10ef_47cf_8d15_44c55aba379f.slice/crio-fb8a96e9b2edc190806de03ce1fa67978a5f795fce2879a866cd75260874b207 WatchSource:0}: Error finding container fb8a96e9b2edc190806de03ce1fa67978a5f795fce2879a866cd75260874b207: Status 404 returned error can't find the container with id fb8a96e9b2edc190806de03ce1fa67978a5f795fce2879a866cd75260874b207
Sep 11 16:02:13.301665 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:13.301641    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099b73e7_be9e_4899_b52e_c62664412f79.slice/crio-164568dfa2694375f9892883bca7aa594894482cb92c618a0ed640ac48069a8a WatchSource:0}: Error finding container 164568dfa2694375f9892883bca7aa594894482cb92c618a0ed640ac48069a8a: Status 404 returned error can't find the container with id 164568dfa2694375f9892883bca7aa594894482cb92c618a0ed640ac48069a8a
Sep 11 16:02:13.768861 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.768769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:13.769012 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.768872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:13.769012 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.768955    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:13.769012 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.768983    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:13.769170 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.769031    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:15.769010684 +0000 UTC m=+6.031256819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:13.769170 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.769050    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:15.76904332 +0000 UTC m=+6.031289443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:13.869932 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:13.869895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:13.870101 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.870085    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:13.870175 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.870110    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:13.870175 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.870123    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:13.870292 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:13.870186    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:15.870167814 +0000 UTC m=+6.132413951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:14.233005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.232909    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:57:12 +0000 UTC" deadline="2028-06-17 12:13:50.157723636 +0000 UTC"
Sep 11 16:02:14.233005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.232955    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15476h11m35.924772961s"
Sep 11 16:02:14.281689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.281653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:14.281869 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:14.281805    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:14.282389 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.282366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:14.282508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.282491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:14.282613 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:14.282490    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:14.282677 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:14.282628    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:14.299945 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.299906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vrmwc" event={"ID":"b8797a6d-39fa-46b4-8b90-412bff41a9ff","Type":"ContainerStarted","Data":"d4a2ade7b1f792a7905ff5593eb81391b8a62c92da11a4eaa0585410ee78a772"}
Sep 11 16:02:14.306233 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.306200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp" event={"ID":"a1dd799f-a66a-4013-b279-50a5feabaf65","Type":"ContainerStarted","Data":"d8d1d5a0e67179418c239ff6e7fa84185b25a9e3232fd91ed7321c7985c405ce"}
Sep 11 16:02:14.310211 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.310180    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c99070bec913754fcbe33325c0994b7" containerID="e2aa5b579b7a2029fd96b12316b7da1a29da978d1c67ad2f6f2337ee6ddbb764" exitCode=0
Sep 11 16:02:14.310331 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.310319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal" event={"ID":"5c99070bec913754fcbe33325c0994b7","Type":"ContainerDied","Data":"e2aa5b579b7a2029fd96b12316b7da1a29da978d1c67ad2f6f2337ee6ddbb764"}
Sep 11 16:02:14.318547 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.317832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qlzm" event={"ID":"099b73e7-be9e-4899-b52e-c62664412f79","Type":"ContainerStarted","Data":"164568dfa2694375f9892883bca7aa594894482cb92c618a0ed640ac48069a8a"}
Sep 11 16:02:14.325362 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.325022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75zgf" event={"ID":"d96f5a19-a75d-42d8-be59-dee9403bd82c","Type":"ContainerStarted","Data":"1d59f8f73944a55ec74b73ac981a33204e27d1ab93be11b70104c8e661375a1e"}
Sep 11 16:02:14.328268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.328225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal" event={"ID":"2fb030d2ec200c8398616ddd90968f8e","Type":"ContainerStarted","Data":"109efa3d836e5ce02155681a6059ba1a12f5c4fe07fe0f225f8ff1acf3122ff2"}
Sep 11 16:02:14.332109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.332080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"451d3aac8f5576f052e494f279a294031c5806985ab1983157fd5d558f2071e7"}
Sep 11 16:02:14.335779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.335752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9rd6q" event={"ID":"411c70e3-10ef-47cf-8d15-44c55aba379f","Type":"ContainerStarted","Data":"fb8a96e9b2edc190806de03ce1fa67978a5f795fce2879a866cd75260874b207"}
Sep 11 16:02:14.358015 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:14.357680    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-9.ec2.internal" podStartSLOduration=3.35766032 podStartE2EDuration="3.35766032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:14.357278478 +0000 UTC m=+4.619524614" watchObservedRunningTime="2026-09-11 16:02:14.35766032 +0000 UTC m=+4.619906460"
Sep 11 16:02:15.352008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:15.351913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal" event={"ID":"5c99070bec913754fcbe33325c0994b7","Type":"ContainerStarted","Data":"394eda5c9b226f3ed9a921e7dbbd036bc5dd80b2720ce4123372c27662a36b73"}
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:15.788672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:15.788733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.788893    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.788960    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.788939734 +0000 UTC m=+10.051185870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.789408    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:15.789568 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.789464    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.789450215 +0000 UTC m=+10.051696354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:15.889268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:15.889226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:15.889446 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.889416    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:15.889446 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.889439    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:15.889581 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.889450    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:15.889581 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:15.889510    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.889491068 +0000 UTC m=+10.151737189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:16.281710 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:16.281629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:16.281861 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:16.281761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:16.282166 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:16.282146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:16.282284 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:16.282261    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:16.284131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:16.284107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:16.284246 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:16.284195    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:18.280939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:18.280940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:18.281095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:18.281094    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:18.281208    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:18.281449 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:18.281288    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:19.821298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:19.821245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:19.821760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:19.821339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:19.821760 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.821449    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:19.821760 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.821507    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:27.821492984 +0000 UTC m=+18.083739108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:19.821760 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.821604    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:19.821760 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.821634    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:27.821625821 +0000 UTC m=+18.083871941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:19.922007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:19.921969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:19.922188 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.922110    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:19.922188 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.922125    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:19.922188 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.922134    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:19.922188 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:19.922185    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:27.922172132 +0000 UTC m=+18.184418265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:20.281071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:20.281168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:20.281185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:20.281293    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:20.281357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:20.281573 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:20.281403    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:22.280482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:22.280446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:22.280929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:22.280446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:22.280929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:22.280589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:22.280929 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:22.280613    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:22.280929 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:22.280716    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:22.280929 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:22.280783    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:24.280402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:24.280312    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:24.280402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:24.280342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:24.280402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:24.280321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:24.280991 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:24.280455    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:24.280991 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:24.280539    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:24.280991 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:24.280592    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:26.280045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:26.280012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:26.280495 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:26.280053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:26.280495 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:26.280012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:26.280495 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:26.280143    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:26.280495 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:26.280227    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:26.280495 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:26.280304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:27.884561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:27.884249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:27.884561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:27.884505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:27.884561 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.884396    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:27.885081 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.884626    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:02:43.884603131 +0000 UTC m=+34.146849264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:27.885081 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.884676    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:27.885081 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.884738    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:02:43.884722005 +0000 UTC m=+34.146968140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:27.985181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:27.985136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:27.985340 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.985298    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:27.985340 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.985317    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:27.985340 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.985331    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:27.985494 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:27.985390    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:43.985374886 +0000 UTC m=+34.247621008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:28.280891 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:28.280806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:28.281304 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:28.281145    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:28.281463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:28.281434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:28.281720 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:28.281674    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:28.281793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:28.281734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:28.284059 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:28.283205    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:30.281326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:30.281289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:30.281810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:30.281412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:30.281810 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:30.281405    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:30.281810 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:30.281549    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:30.281810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:30.281567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:30.281810 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:30.281695    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:32.280458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.280189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:32.281305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.280221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:32.281305 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:32.280490    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:32.281305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.280221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:32.281305 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:32.280604    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:32.281305 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:32.280681    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:32.393801 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.393759    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="7fdfee73f86e6aa43e3fb311fc36b9724ec54f5043071b43112c1f703652fd9f" exitCode=0
Sep 11 16:02:32.394011 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.393861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"7fdfee73f86e6aa43e3fb311fc36b9724ec54f5043071b43112c1f703652fd9f"}
Sep 11 16:02:32.397215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397195    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:02:32.397577 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397555    2564 generic.go:356] "Generic (PLEG): container finished" podID="2ff4d80e-c970-4f2f-a72d-913d405ec8c4" containerID="665129bc935636ac709489941b57c7a53896a90a4de32c84cf40eed49777984e" exitCode=1
Sep 11 16:02:32.397642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"339f094f8a145cdef07cf6e9ddb741046158e8b4b9537ad6b291482adb56ecac"}
Sep 11 16:02:32.397714 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"2ece146e5d48ed68ec66211c52f0984b535d787663c2c7ffa3e998d5f3aacd62"}
Sep 11 16:02:32.397758 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"0c56f8f251451426e502c2dd4067e7a9c72db2bed0754636a35abb5171ad68ff"}
Sep 11 16:02:32.397790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"b90e4df0617e9191f585d6ec446f41b4f3b507484934d8081ee2f1c8c2fd118f"}
Sep 11 16:02:32.397834 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerDied","Data":"665129bc935636ac709489941b57c7a53896a90a4de32c84cf40eed49777984e"}
Sep 11 16:02:32.397872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.397854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"3a357040266374b10b621301ffd509ee742ef6ed5de765bed7a414b1ed526a75"}
Sep 11 16:02:32.399098 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.399073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9rd6q" event={"ID":"411c70e3-10ef-47cf-8d15-44c55aba379f","Type":"ContainerStarted","Data":"4edb523559f89d16358dea9bec7af8fc9089d66b3ef65633e8461a7dd52839f1"}
Sep 11 16:02:32.400614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.400584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vrmwc" event={"ID":"b8797a6d-39fa-46b4-8b90-412bff41a9ff","Type":"ContainerStarted","Data":"3c58b1d7ca9261b43befd723b3786075f877e52076fe6449a649537bb2245087"}
Sep 11 16:02:32.402069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.402047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp" event={"ID":"a1dd799f-a66a-4013-b279-50a5feabaf65","Type":"ContainerStarted","Data":"785c592380f7b96d40e52c5c70e8b41c28b1f54bd6f3cec852bbd2699d6dfc36"}
Sep 11 16:02:32.403402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.403384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2pdv" event={"ID":"c4b6b749-b75d-48b2-986a-5e0e6c73a4c3","Type":"ContainerStarted","Data":"ed24a501bf8c554b1f59f41db86b0ed1085ba147dd9d231a1ca3359390d6546e"}
Sep 11 16:02:32.404776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.404755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qlzm" event={"ID":"099b73e7-be9e-4899-b52e-c62664412f79","Type":"ContainerStarted","Data":"d6f190c5417f6f3169a6697653e0c04a4340645fbbb217e1ea7ab54839edb6ea"}
Sep 11 16:02:32.406065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.406037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75zgf" event={"ID":"d96f5a19-a75d-42d8-be59-dee9403bd82c","Type":"ContainerStarted","Data":"16fd470ec22417666bdf032cd77d8efb759e1a9edf779a784b3dae382f4a8fac"}
Sep 11 16:02:32.418579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.418502    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-9.ec2.internal" podStartSLOduration=21.418487544 podStartE2EDuration="21.418487544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:15.37072781 +0000 UTC m=+5.632973968" watchObservedRunningTime="2026-09-11 16:02:32.418487544 +0000 UTC m=+22.680733685"
Sep 11 16:02:32.433592 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.433511    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9rd6q" podStartSLOduration=8.291449683 podStartE2EDuration="22.433481853s" totalImagesPullingTime="14.14203217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:32.432394372 +0000 UTC m=+22.694640514" watchObservedRunningTime="2026-09-11 16:02:32.433481853 +0000 UTC m=+22.695728012"
Sep 11 16:02:32.447278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.447236    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-75zgf" podStartSLOduration=4.46435695 podStartE2EDuration="22.447224385s" totalImagesPullingTime="17.982867435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:32.446995096 +0000 UTC m=+22.709241236" watchObservedRunningTime="2026-09-11 16:02:32.447224385 +0000 UTC m=+22.709470526"
Sep 11 16:02:32.464661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.464619    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d2pdv" podStartSLOduration=4.437633252 podStartE2EDuration="22.464606864s" totalImagesPullingTime="18.026973612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:32.464362767 +0000 UTC m=+22.726608910" watchObservedRunningTime="2026-09-11 16:02:32.464606864 +0000 UTC m=+22.726853007"
Sep 11 16:02:32.484675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.484630    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vrmwc" podStartSLOduration=4.500493699 podStartE2EDuration="22.484615393s" totalImagesPullingTime="17.984121694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:32.483773118 +0000 UTC m=+22.746019264" watchObservedRunningTime="2026-09-11 16:02:32.484615393 +0000 UTC m=+22.746861536"
Sep 11 16:02:32.524147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.524099    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8qlzm" podStartSLOduration=4.469842822 podStartE2EDuration="22.524084484s" totalImagesPullingTime="18.054241662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:32.523729844 +0000 UTC m=+22.785975987" watchObservedRunningTime="2026-09-11 16:02:32.524084484 +0000 UTC m=+22.786330626"
Sep 11 16:02:32.641407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.641312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:32.641979 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:32.641961    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:33.410301 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:33.410261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4gq9z" event={"ID":"6a94d97e-ef59-4649-ac5a-6aa18d714cd1","Type":"ContainerStarted","Data":"6f7aab75863bc4eb059304519b7c396adfee292345c5ca22062fca1cd620f22a"}
Sep 11 16:02:33.411231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:33.411212    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:33.411829 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:33.411801    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9rd6q"
Sep 11 16:02:33.428245 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:33.428186    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4gq9z" podStartSLOduration=5.413354594 podStartE2EDuration="23.428165463s" totalImagesPullingTime="18.014810869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:33.428067269 +0000 UTC m=+23.690313413" watchObservedRunningTime="2026-09-11 16:02:33.428165463 +0000 UTC m=+23.690411627"
Sep 11 16:02:33.741571 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:33.741541    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 16:02:34.221309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.221060    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T16:02:33.741564807Z","UUID":"c846cbba-078e-4d11-ba72-7ea5aa0aa8d8","Handler":null,"Name":"","Endpoint":""}
Sep 11 16:02:34.222600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.222577    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 16:02:34.222736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.222610    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 16:02:34.280503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.280389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:34.280503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.280389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:34.280745 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:34.280559    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:34.280745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.280400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:34.280745 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:34.280621    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:34.280745 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:34.280678    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:34.416984 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.416958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:02:34.417435 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.417406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"4918f152b80b0a0806ed4e4caafa9a3db1f936dab102d30b1b72ec1ed8bae34e"}
Sep 11 16:02:34.419411 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:34.419380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp" event={"ID":"a1dd799f-a66a-4013-b279-50a5feabaf65","Type":"ContainerStarted","Data":"b8808862e47698053579a5ef120facb218721c59216fa0a8b934b343c4cc0829"}
Sep 11 16:02:35.424264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:35.424221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp" event={"ID":"a1dd799f-a66a-4013-b279-50a5feabaf65","Type":"ContainerStarted","Data":"4f8b2d7d4eab6c67a983a0a4be798c0cb9b6d9e86348be53eef1b548a3a2abf6"}
Sep 11 16:02:35.445879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:35.445830    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h7vp" podStartSLOduration=4.336767727 podStartE2EDuration="25.445816622s" totalImagesPullingTime="21.109048895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:35.445428137 +0000 UTC m=+25.707674281" watchObservedRunningTime="2026-09-11 16:02:35.445816622 +0000 UTC m=+25.708062773"
Sep 11 16:02:36.280621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:36.280586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:36.280811 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:36.280598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:36.280811 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:36.280715    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:36.280811 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:36.280728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:36.280942 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:36.280836    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:36.280942 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:36.280930    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:37.434445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.434374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:02:37.434835 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.434806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"6b57d10053120142ac58638c977b772e3a45070c16c6d8a363c2aca312cee8d2"}
Sep 11 16:02:37.438245 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.438209    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:37.438723 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.438700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:37.438836 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.438773    2564 scope.go:117] "RemoveContainer" containerID="665129bc935636ac709489941b57c7a53896a90a4de32c84cf40eed49777984e"
Sep 11 16:02:37.454830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:37.454811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:38.280719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.280538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:38.280894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.280545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:38.280894 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:38.280781    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:38.280894 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:38.280877    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:38.281053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.280593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:38.281053 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:38.280992    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:38.443894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.443816    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="cd9c2b65432800834f28885705a9df50f3f0c53b94acc253be6c993fd6e265a3" exitCode=0
Sep 11 16:02:38.444266 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.443931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"cd9c2b65432800834f28885705a9df50f3f0c53b94acc253be6c993fd6e265a3"}
Sep 11 16:02:38.449446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.449426    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:02:38.449997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.449960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" event={"ID":"2ff4d80e-c970-4f2f-a72d-913d405ec8c4","Type":"ContainerStarted","Data":"c6e1209952d86dec022060e3b7f5196405b25f76b205b82571696234f602eab4"}
Sep 11 16:02:38.450195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.450177    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:38.472753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:38.472723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:02:39.229243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.229176    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2" podStartSLOduration=11.184620672 podStartE2EDuration="29.229157289s" totalImagesPullingTime="18.044536617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:38.524974157 +0000 UTC m=+28.787220312" watchObservedRunningTime="2026-09-11 16:02:39.229157289 +0000 UTC m=+29.491403477"
Sep 11 16:02:39.229434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.229417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qnghp"]
Sep 11 16:02:39.229610 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.229594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:39.229845 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:39.229815    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:39.233912 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.233889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mw5w6"]
Sep 11 16:02:39.234038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.234016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:39.234178 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:39.234141    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:39.239647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.239620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shknl"]
Sep 11 16:02:39.239765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:39.239744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:39.239868 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:39.239848    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:40.280806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:40.280774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:40.281472 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:40.280866    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:40.457435 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:40.457399    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="3b471a772f1284662e599221f2bc7cfa8428ce292bc2ff3c5afefa35aa40891e" exitCode=0
Sep 11 16:02:40.457628 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:40.457488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"3b471a772f1284662e599221f2bc7cfa8428ce292bc2ff3c5afefa35aa40891e"}
Sep 11 16:02:41.280259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:41.280081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:41.280404 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:41.280341    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:41.280404 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:41.280085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:41.280547 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:41.280505    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:42.280691 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:42.280657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:42.281071 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:42.280769    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qnghp" podUID="e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb"
Sep 11 16:02:42.464013 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:42.463980    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="b1c9bb13b3e785bd61c6e3bf37466d7f0f14bd8ada96af3a93d7e00cd71d55e0" exitCode=0
Sep 11 16:02:42.464177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:42.464037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"b1c9bb13b3e785bd61c6e3bf37466d7f0f14bd8ada96af3a93d7e00cd71d55e0"}
Sep 11 16:02:43.280386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.280350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:43.280386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.280377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:43.280637 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.280485    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mw5w6" podUID="8ef21e1a-60b6-4451-9d9b-e803dd029c4e"
Sep 11 16:02:43.280637 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.280614    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shknl" podUID="59ab0ef8-e96a-4fab-a75d-a6713af2c11b"
Sep 11 16:02:43.903728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.903694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:43.904182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.903770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:43.904182 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.903851    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:43.904182 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.903863    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:43.904182 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.903919    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:03:15.903899875 +0000 UTC m=+66.166145995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:43.904182 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:43.903935    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret podName:e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb nodeName:}" failed. No retries permitted until 2026-09-11 16:03:15.903926922 +0000 UTC m=+66.166173043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret") pod "global-pull-secret-syncer-qnghp" (UID: "e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:43.962734 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.962703    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-9.ec2.internal" event="NodeReady"
Sep 11 16:02:43.962906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:43.962865    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 16:02:44.004612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.004574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:44.004793 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.004741    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:44.004793 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.004768    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:44.004793 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.004781    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bzbjr for pod openshift-network-diagnostics/network-check-target-mw5w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:44.004897 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.004845    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr podName:8ef21e1a-60b6-4451-9d9b-e803dd029c4e nodeName:}" failed. No retries permitted until 2026-09-11 16:03:16.004828582 +0000 UTC m=+66.267074724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbjr" (UniqueName: "kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr") pod "network-check-target-mw5w6" (UID: "8ef21e1a-60b6-4451-9d9b-e803dd029c4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:44.007176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.007146    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:02:44.023852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.023824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.026925 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.026897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 16:02:44.027086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.026928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 16:02:44.027232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.027216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4k2h9\""
Sep 11 16:02:44.027421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.027398    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 16:02:44.036861 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.036838    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 16:02:44.045177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.045140    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sth7n"]
Sep 11 16:02:44.060536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.060497    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mm8md"]
Sep 11 16:02:44.060716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.060635    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.066729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.066424    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lgnfp\""
Sep 11 16:02:44.066729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.066725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 16:02:44.066907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.066806    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 16:02:44.072667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.072640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:02:44.072800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.072681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sth7n"]
Sep 11 16:02:44.072800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.072706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mm8md"]
Sep 11 16:02:44.072800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.072796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.075772 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.075746    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 16:02:44.075979 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.075948    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gkgdt\""
Sep 11 16:02:44.076268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.076247    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 16:02:44.076436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.076275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 16:02:44.078973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.078910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:44.105241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n96k\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.105776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.105535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.206650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c956b3a-2e06-470b-98d9-1a9402055475-config-volume\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.206650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.206909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.206909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n96k\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.206909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.207031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.206973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmk9k\" (UniqueName: \"kubernetes.io/projected/81d531fa-cf83-4040-8b45-41e3820705c1-kube-api-access-kmk9k\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.207031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4jk\" (UniqueName: \"kubernetes.io/projected/0c956b3a-2e06-470b-98d9-1a9402055475-kube-api-access-hh4jk\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.207181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.207181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c956b3a-2e06-470b-98d9-1a9402055475-tmp-dir\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.207363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.207186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d531fa-cf83-4040-8b45-41e3820705c1-cert\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.207363 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.207258    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:44.207363 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.207273    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:44.207363 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.207323    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:44.707305411 +0000 UTC m=+34.969551545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:44.208109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.208087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.208450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.208429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.212086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.212063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.213863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.213839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.216706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.216681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.216806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.216773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n96k\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.280064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.280029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:02:44.283614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.283590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:02:44.308502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c956b3a-2e06-470b-98d9-1a9402055475-tmp-dir\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.308677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d531fa-cf83-4040-8b45-41e3820705c1-cert\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.308677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c956b3a-2e06-470b-98d9-1a9402055475-config-volume\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.308677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.308677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk9k\" (UniqueName: \"kubernetes.io/projected/81d531fa-cf83-4040-8b45-41e3820705c1-kube-api-access-kmk9k\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.308842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4jk\" (UniqueName: \"kubernetes.io/projected/0c956b3a-2e06-470b-98d9-1a9402055475-kube-api-access-hh4jk\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.308927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.308833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c956b3a-2e06-470b-98d9-1a9402055475-tmp-dir\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.308983 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.308946    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:44.309031 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.309003    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:44.808982593 +0000 UTC m=+35.071228730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:44.309502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.309473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c956b3a-2e06-470b-98d9-1a9402055475-config-volume\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.311637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.311612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d531fa-cf83-4040-8b45-41e3820705c1-cert\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.321060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.321004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4jk\" (UniqueName: \"kubernetes.io/projected/0c956b3a-2e06-470b-98d9-1a9402055475-kube-api-access-hh4jk\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.326010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.325987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk9k\" (UniqueName: \"kubernetes.io/projected/81d531fa-cf83-4040-8b45-41e3820705c1-kube-api-access-kmk9k\") pod \"ingress-canary-mm8md\" (UID: \"81d531fa-cf83-4040-8b45-41e3820705c1\") " pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.383864 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.383826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mm8md"
Sep 11 16:02:44.687143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.687052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mm8md"]
Sep 11 16:02:44.691596 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:02:44.691567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d531fa_cf83_4040_8b45_41e3820705c1.slice/crio-5f58d16f7ac9a057007cfd5f5a93f49e6257c00ff8e5f885712bc51188df2672 WatchSource:0}: Error finding container 5f58d16f7ac9a057007cfd5f5a93f49e6257c00ff8e5f885712bc51188df2672: Status 404 returned error can't find the container with id 5f58d16f7ac9a057007cfd5f5a93f49e6257c00ff8e5f885712bc51188df2672
Sep 11 16:02:44.713222 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.713187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:44.713359 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.713301    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:44.713359 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.713317    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:44.713435 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.713372    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:45.713355861 +0000 UTC m=+35.975601998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:44.814586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.814543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:44.814775 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.814752    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:44.814857 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:44.814844    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:45.814821308 +0000 UTC m=+36.077067443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:44.902781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:44.902738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:45.004294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.004193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:45.280361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.280281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:02:45.280361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.280325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:02:45.283033 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.283007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:02:45.283187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.283093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:02:45.284191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.284170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tt876\""
Sep 11 16:02:45.284316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.284190    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkwl5\""
Sep 11 16:02:45.284316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.284256    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:02:45.474765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.474727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mm8md" event={"ID":"81d531fa-cf83-4040-8b45-41e3820705c1","Type":"ContainerStarted","Data":"5f58d16f7ac9a057007cfd5f5a93f49e6257c00ff8e5f885712bc51188df2672"}
Sep 11 16:02:45.727564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.727462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:45.727715 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:45.727650    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:45.727715 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:45.727668    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:45.727798 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:45.727733    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:47.727712687 +0000 UTC m=+37.989958823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:45.804830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.804793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:45.828989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.828958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:45.829157 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:45.829067    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:45.829157 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:45.829119    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:47.82910113 +0000 UTC m=+38.091347267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:45.905635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:45.905594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:47.483913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:47.483821    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="a1ced06dc7a4cbf19e88e38a44507d11ba30b4e0e1cba6551273fb431528d3c1" exitCode=0
Sep 11 16:02:47.483913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:47.483891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"a1ced06dc7a4cbf19e88e38a44507d11ba30b4e0e1cba6551273fb431528d3c1"}
Sep 11 16:02:47.745798 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:47.745704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:47.745925 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:47.745872    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:47.745925 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:47.745891    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:47.746028 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:47.745955    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:51.745933373 +0000 UTC m=+42.008179516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:47.846753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:47.846709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:47.846936 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:47.846878    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:47.847003 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:47.846957    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:51.84693716 +0000 UTC m=+42.109183293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:48.491373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:48.491331    2564 generic.go:356] "Generic (PLEG): container finished" podID="3961737d-819b-4805-82d0-25c998cf6bc5" containerID="c9f7db5dfbad5b7f1edc00ee35077d33ca3b485de61cbc76737c2176aad8666c" exitCode=0
Sep 11 16:02:48.491968 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:48.491415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerDied","Data":"c9f7db5dfbad5b7f1edc00ee35077d33ca3b485de61cbc76737c2176aad8666c"}
Sep 11 16:02:49.500290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.500258    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" event={"ID":"3961737d-819b-4805-82d0-25c998cf6bc5","Type":"ContainerStarted","Data":"fc3a64f88406701bc3c98768f371223ef02e0395b6ea75b92987c749b3d99a47"}
Sep 11 16:02:49.501791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.501764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mm8md" event={"ID":"81d531fa-cf83-4040-8b45-41e3820705c1","Type":"ContainerStarted","Data":"e9ecbb3e233e2f2839f4ea1feab5a9251a544a184cea6808daf0502e8a5d6d81"}
Sep 11 16:02:49.531568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.531492    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bhv8x" podStartSLOduration=9.670724029 podStartE2EDuration="39.531477446s" totalImagesPullingTime="29.860753417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:49.529628413 +0000 UTC m=+39.791874557" watchObservedRunningTime="2026-09-11 16:02:49.531477446 +0000 UTC m=+39.793723587"
Sep 11 16:02:49.548159 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.548111    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mm8md" podStartSLOduration=0.96882841 podStartE2EDuration="5.54809532s" totalImagesPullingTime="4.57926691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:49.547389591 +0000 UTC m=+39.809635746" watchObservedRunningTime="2026-09-11 16:02:49.54809532 +0000 UTC m=+39.810341462"
Sep 11 16:02:49.725541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.725281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:49.959332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:49.959293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:51.776693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:51.776657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:51.777047 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:51.776823    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:51.777047 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:51.776843    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:51.777047 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:51.776899    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:59.776883739 +0000 UTC m=+50.039129884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:51.877949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:51.877913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:51.878076 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:51.878058    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:51.878139 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:51.878130    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:59.878116225 +0000 UTC m=+50.140362345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:52.246023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:52.245880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:52.304158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:52.304126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:54.745767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:54.745729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:54.843507 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:54.843454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:57.017164 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:57.017124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:57.118317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:57.118279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:02:59.833145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:59.833092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:02:59.833577 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:59.833220    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:02:59.833577 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:59.833232    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:02:59.833577 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:59.833286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:15.833271773 +0000 UTC m=+66.095517894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:02:59.933656 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:02:59.933613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:02:59.933795 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:59.933774    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:59.933852 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:02:59.933843    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls podName:0c956b3a-2e06-470b-98d9-1a9402055475 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:15.933827042 +0000 UTC m=+66.196073162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls") pod "dns-default-sth7n" (UID: "0c956b3a-2e06-470b-98d9-1a9402055475") : secret "dns-default-metrics-tls" not found
Sep 11 16:03:00.428847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:00.428801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:00.799576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:00.799546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:00.901709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:00.901674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:01.337244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.337209    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-wzntf"]
Sep 11 16:03:01.338882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.338860    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.342472 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.342449    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 16:03:01.342613 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.342602    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 16:03:01.342681 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.342609    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 16:03:01.342734 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.342724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xfxlp\""
Sep 11 16:03:01.344032 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.344017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 16:03:01.348502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.348480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 16:03:01.356922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.356900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-wzntf"]
Sep 11 16:03:01.444671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-service-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.444671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-serving-cert\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.444910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.444910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-snapshots\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.444910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwfj9\" (UniqueName: \"kubernetes.io/projected/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-kube-api-access-zwfj9\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.444910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.444870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-tmp\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwfj9\" (UniqueName: \"kubernetes.io/projected/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-kube-api-access-zwfj9\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-tmp\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-service-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-serving-cert\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.545717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.545636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-snapshots\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.546135 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.546114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-service-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.546212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.546199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-tmp\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.546306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.546284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-snapshots\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.546456 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.546437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-trusted-ca-bundle\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.549156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.549138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-serving-cert\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.554412 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.554384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwfj9\" (UniqueName: \"kubernetes.io/projected/f9f9ac78-f480-4e91-8de6-0e3ad1b45457-kube-api-access-zwfj9\") pod \"insights-operator-5844b856db-wzntf\" (UID: \"f9f9ac78-f480-4e91-8de6-0e3ad1b45457\") " pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.557150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.557121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:01.648423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.648334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-wzntf"
Sep 11 16:03:01.658860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.658824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:01.919964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:01.919887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-wzntf"]
Sep 11 16:03:01.923768 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:01.923732    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f9ac78_f480_4e91_8de6_0e3ad1b45457.slice/crio-4cd64f46d0cca54782c656e2835834de2bddf4bbb62b72ef0aa5c432601af5fa WatchSource:0}: Error finding container 4cd64f46d0cca54782c656e2835834de2bddf4bbb62b72ef0aa5c432601af5fa: Status 404 returned error can't find the container with id 4cd64f46d0cca54782c656e2835834de2bddf4bbb62b72ef0aa5c432601af5fa
Sep 11 16:03:02.534633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:02.534589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wzntf" event={"ID":"f9f9ac78-f480-4e91-8de6-0e3ad1b45457","Type":"ContainerStarted","Data":"4cd64f46d0cca54782c656e2835834de2bddf4bbb62b72ef0aa5c432601af5fa"}
Sep 11 16:03:04.007737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:04.007702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:04.111458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:04.111413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:05.545139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.545098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wzntf" event={"ID":"f9f9ac78-f480-4e91-8de6-0e3ad1b45457","Type":"ContainerStarted","Data":"aea8e94fc399e30811dab88efe9da47867b0b63e903f4ddca02f1b1866da1098"}
Sep 11 16:03:05.568420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.568345    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-wzntf" podStartSLOduration=1.8074148559999998 podStartE2EDuration="4.568323928s" totalImagesPullingTime="2.760909072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:05.56775741 +0000 UTC m=+55.830003554" watchObservedRunningTime="2026-09-11 16:03:05.568323928 +0000 UTC m=+55.830570085"
Sep 11 16:03:05.605816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.605786    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d89wq"]
Sep 11 16:03:05.607907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.607883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.612152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.612127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 16:03:05.612552 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.612508    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 16:03:05.612610 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.612561    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpkn\""
Sep 11 16:03:05.624243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.624214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d89wq"]
Sep 11 16:03:05.682077 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.682042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:05.748458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.748423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:05.779488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.779442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.779488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.779487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml87v\" (UniqueName: \"kubernetes.io/projected/72026b0e-d0b7-422b-b5ef-990410eae593-kube-api-access-ml87v\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.779727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.779613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72026b0e-d0b7-422b-b5ef-990410eae593-crio-socket\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.779727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.779667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.779727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.779700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72026b0e-d0b7-422b-b5ef-990410eae593-data-volume\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.811677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.811592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:05.880679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.880679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml87v\" (UniqueName: \"kubernetes.io/projected/72026b0e-d0b7-422b-b5ef-990410eae593-kube-api-access-ml87v\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.880901 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:05.880793    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:05.880901 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:05.880851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:06.380837311 +0000 UTC m=+56.643083431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:05.880901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72026b0e-d0b7-422b-b5ef-990410eae593-crio-socket\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.880901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.881098 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72026b0e-d0b7-422b-b5ef-990410eae593-crio-socket\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.881098 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.880913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72026b0e-d0b7-422b-b5ef-990410eae593-data-volume\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.881098 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:05.881031    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:05.881222 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:05.881128    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:06.381109374 +0000 UTC m=+56.643355527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:05.881222 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.881179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72026b0e-d0b7-422b-b5ef-990410eae593-data-volume\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.890276 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.890242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml87v\" (UniqueName: \"kubernetes.io/projected/72026b0e-d0b7-422b-b5ef-990410eae593-kube-api-access-ml87v\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:05.911847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:05.911808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:06.054799 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:06.054764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:06.385608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:06.385566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:06.385794 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:06.385645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:06.385794 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:06.385698    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:06.385794 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:06.385760    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:06.385794 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:06.385768    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:07.385752005 +0000 UTC m=+57.647998128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:06.385939 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:06.385800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:07.385788687 +0000 UTC m=+57.648034825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.394586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.394540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:07.395071 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.394618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:07.395071 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:07.394705    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:07.395071 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:07.394710    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.395071 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:07.394765    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.394748871 +0000 UTC m=+59.656994993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:07.395071 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:07.394778    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.394772607 +0000 UTC m=+59.657018727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.454373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.454338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:07.567041 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.567006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:07.655820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.655738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:07.756041 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.756010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:07.759147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.759126    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vrmwc_b8797a6d-39fa-46b4-8b90-412bff41a9ff/dns-node-resolver/0.log"
Sep 11 16:03:07.963634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.963542    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rd965"]
Sep 11 16:03:07.967969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.967388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965"
Sep 11 16:03:07.970580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.970559    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8xz9z\""
Sep 11 16:03:07.976394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.976369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rd965"]
Sep 11 16:03:07.999238 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:07.999207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcnl\" (UniqueName: \"kubernetes.io/projected/8a258d86-b2e0-4095-a9fe-96c08fb45ca3-kube-api-access-fjcnl\") pod \"network-check-source-6f8b768455-rd965\" (UID: \"8a258d86-b2e0-4095-a9fe-96c08fb45ca3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965"
Sep 11 16:03:08.100027 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.099984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcnl\" (UniqueName: \"kubernetes.io/projected/8a258d86-b2e0-4095-a9fe-96c08fb45ca3-kube-api-access-fjcnl\") pod \"network-check-source-6f8b768455-rd965\" (UID: \"8a258d86-b2e0-4095-a9fe-96c08fb45ca3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965"
Sep 11 16:03:08.112984 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.112947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcnl\" (UniqueName: \"kubernetes.io/projected/8a258d86-b2e0-4095-a9fe-96c08fb45ca3-kube-api-access-fjcnl\") pod \"network-check-source-6f8b768455-rd965\" (UID: \"8a258d86-b2e0-4095-a9fe-96c08fb45ca3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965"
Sep 11 16:03:08.135355 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.135326    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-q9wp5"]
Sep 11 16:03:08.137148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.137131    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.140357 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.140331    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 16:03:08.140357 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.140333    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 16:03:08.140655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.140633    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 16:03:08.140755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.140742    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-l9mmz\""
Sep 11 16:03:08.141461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.141441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 16:03:08.154746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.154718    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-q9wp5"]
Sep 11 16:03:08.200696 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.200658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-key\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.200887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.200714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-cabundle\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.200887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.200793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvs6n\" (UniqueName: \"kubernetes.io/projected/adebac52-0564-4d60-9a1e-5b7a431a56b0-kube-api-access-qvs6n\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.255580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.255495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:08.277485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.277454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965"
Sep 11 16:03:08.301760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.301720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-key\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.301928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.301780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-cabundle\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.301928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.301881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6n\" (UniqueName: \"kubernetes.io/projected/adebac52-0564-4d60-9a1e-5b7a431a56b0-kube-api-access-qvs6n\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.302514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.302496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-cabundle\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.304453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.304435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adebac52-0564-4d60-9a1e-5b7a431a56b0-signing-key\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.317074 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.317043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvs6n\" (UniqueName: \"kubernetes.io/projected/adebac52-0564-4d60-9a1e-5b7a431a56b0-kube-api-access-qvs6n\") pod \"service-ca-568869fdc5-q9wp5\" (UID: \"adebac52-0564-4d60-9a1e-5b7a431a56b0\") " pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.356328 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.356267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:08.360970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.360947    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75zgf_d96f5a19-a75d-42d8-be59-dee9403bd82c/node-ca/0.log"
Sep 11 16:03:08.446502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.446464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-q9wp5"
Sep 11 16:03:08.557989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.557958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rd965"]
Sep 11 16:03:08.561066 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:08.561038    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a258d86_b2e0_4095_a9fe_96c08fb45ca3.slice/crio-bfc215e9b00c1317c5a03718f838df55019ed42907b7680f7a7499a4036b94e8 WatchSource:0}: Error finding container bfc215e9b00c1317c5a03718f838df55019ed42907b7680f7a7499a4036b94e8: Status 404 returned error can't find the container with id bfc215e9b00c1317c5a03718f838df55019ed42907b7680f7a7499a4036b94e8
Sep 11 16:03:08.612730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.612699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:08.726104 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:08.726074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-q9wp5"]
Sep 11 16:03:08.730124 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:08.730098    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadebac52_0564_4d60_9a1e_5b7a431a56b0.slice/crio-f9f0fc40738ace1e3eda2461c5585354c0cacf5bdf08beee68f6b948d6b3c018 WatchSource:0}: Error finding container f9f0fc40738ace1e3eda2461c5585354c0cacf5bdf08beee68f6b948d6b3c018: Status 404 returned error can't find the container with id f9f0fc40738ace1e3eda2461c5585354c0cacf5bdf08beee68f6b948d6b3c018
Sep 11 16:03:09.369119 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.369083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:09.410228 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.410142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:09.410402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.410256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:09.410402 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:09.410326    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:09.410402 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:09.410358    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:09.410592 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:09.410411    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:13.410387714 +0000 UTC m=+63.672633839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:09.410592 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:09.410434    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:13.410423878 +0000 UTC m=+63.672669998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:09.557460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.557419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965" event={"ID":"8a258d86-b2e0-4095-a9fe-96c08fb45ca3","Type":"ContainerStarted","Data":"bfc215e9b00c1317c5a03718f838df55019ed42907b7680f7a7499a4036b94e8"}
Sep 11 16:03:09.558634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.558607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-q9wp5" event={"ID":"adebac52-0564-4d60-9a1e-5b7a431a56b0","Type":"ContainerStarted","Data":"f9f0fc40738ace1e3eda2461c5585354c0cacf5bdf08beee68f6b948d6b3c018"}
Sep 11 16:03:09.564893 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:09.564863    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mm8md_81d531fa-cf83-4040-8b45-41e3820705c1/serve-healthcheck-canary/0.log"
Sep 11 16:03:10.477695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:10.477659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wmjq2"
Sep 11 16:03:11.566889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:11.566850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-q9wp5" event={"ID":"adebac52-0564-4d60-9a1e-5b7a431a56b0","Type":"ContainerStarted","Data":"9b3b119eb6b6ed2e2c802d68ffca93296456ce4848905271571fdc7373717b29"}
Sep 11 16:03:12.571205 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:12.571165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965" event={"ID":"8a258d86-b2e0-4095-a9fe-96c08fb45ca3","Type":"ContainerStarted","Data":"ad01eeaaba5ff5ade99f2bb6a71f349cd5345f58377485f3c5ea02816f3924b5"}
Sep 11 16:03:12.595939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:12.595884    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rd965" podStartSLOduration=1.981066666 podStartE2EDuration="5.595870009s" totalImagesPullingTime="3.614803343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:12.59547866 +0000 UTC m=+62.857724803" watchObservedRunningTime="2026-09-11 16:03:12.595870009 +0000 UTC m=+62.858116150"
Sep 11 16:03:12.596118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:12.596077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-q9wp5" podStartSLOduration=2.393412518 podStartE2EDuration="4.596071277s" totalImagesPullingTime="2.202658759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:11.594338635 +0000 UTC m=+61.856584775" watchObservedRunningTime="2026-09-11 16:03:12.596071277 +0000 UTC m=+62.858317419"
Sep 11 16:03:12.911933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:12.911849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:13.048537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.048495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:13.259262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.259228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:13.356413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.356377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:13.447845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.447800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:13.448066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.447877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:13.448066 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:13.447984    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:13.448066 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:13.448049    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:13.448066 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:13.448064    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:21.44804284 +0000 UTC m=+71.710288975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:13.448284 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:13.448100    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:21.448085243 +0000 UTC m=+71.710331385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:13.494513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.494477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:13.598542 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:13.598429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:14.360319 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:14.360275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:14.546973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:14.546942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:14.981931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:14.981894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:15.149417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.149378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:15.868339 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.868302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:03:15.868551 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:15.868468    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:15.868551 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:15.868488    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64979dc55b-b5j85: secret "image-registry-tls" not found
Sep 11 16:03:15.868641 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:15.868565    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls podName:173b7982-ea9c-43e7-ad7e-91cf405de255 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:47.868548239 +0000 UTC m=+98.130794363 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls") pod "image-registry-64979dc55b-b5j85" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255") : secret "image-registry-tls" not found
Sep 11 16:03:15.969210 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.969178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:03:15.969369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.969220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:03:15.969369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.969253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:03:15.971693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.971672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c956b3a-2e06-470b-98d9-1a9402055475-metrics-tls\") pod \"dns-default-sth7n\" (UID: \"0c956b3a-2e06-470b-98d9-1a9402055475\") " pod="openshift-dns/dns-default-sth7n"
Sep 11 16:03:15.973390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.973364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:03:15.973508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.973428    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:03:15.980033 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:15.980006    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 16:03:15.980148 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:15.980083    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs podName:59ab0ef8-e96a-4fab-a75d-a6713af2c11b nodeName:}" failed. No retries permitted until 2026-09-11 16:04:19.980062112 +0000 UTC m=+130.242308250 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs") pod "network-metrics-daemon-shknl" (UID: "59ab0ef8-e96a-4fab-a75d-a6713af2c11b") : secret "metrics-daemon-secret" not found
Sep 11 16:03:15.982055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:15.982034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb-original-pull-secret\") pod \"global-pull-secret-syncer-qnghp\" (UID: \"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb\") " pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:03:16.070145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.070107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:03:16.072763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.072739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbjr\" (UniqueName: \"kubernetes.io/projected/8ef21e1a-60b6-4451-9d9b-e803dd029c4e-kube-api-access-bzbjr\") pod \"network-check-target-mw5w6\" (UID: \"8ef21e1a-60b6-4451-9d9b-e803dd029c4e\") " pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:03:16.090685 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.090646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qnghp"
Sep 11 16:03:16.176255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.176226    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lgnfp\""
Sep 11 16:03:16.183006 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.182976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sth7n"
Sep 11 16:03:16.197122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.197100    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkwl5\""
Sep 11 16:03:16.204537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.204496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:03:16.371099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.371066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qnghp"]
Sep 11 16:03:16.374426 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:16.374393    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode747732e_9b92_4c3e_9bbf_72b2ae4d7cbb.slice/crio-e1dc10b09a2d01f0d5044d9a650ecbcc8f0a29c47aa2b9e3c00dbbdaa58254a3 WatchSource:0}: Error finding container e1dc10b09a2d01f0d5044d9a650ecbcc8f0a29c47aa2b9e3c00dbbdaa58254a3: Status 404 returned error can't find the container with id e1dc10b09a2d01f0d5044d9a650ecbcc8f0a29c47aa2b9e3c00dbbdaa58254a3
Sep 11 16:03:16.457972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.457395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sth7n"]
Sep 11 16:03:16.462659 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:16.462627    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c956b3a_2e06_470b_98d9_1a9402055475.slice/crio-b28db5ceecd9d7f6d62110ce5277b765c625a43cfcfde64c43db358285dcd312 WatchSource:0}: Error finding container b28db5ceecd9d7f6d62110ce5277b765c625a43cfcfde64c43db358285dcd312: Status 404 returned error can't find the container with id b28db5ceecd9d7f6d62110ce5277b765c625a43cfcfde64c43db358285dcd312
Sep 11 16:03:16.483916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.483886    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mw5w6"]
Sep 11 16:03:16.486812 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:16.486785    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef21e1a_60b6_4451_9d9b_e803dd029c4e.slice/crio-7bcce64a1d324e24cf1226b83df7dfda7b0d1da4a96e95f629801e7d6ebd75fb WatchSource:0}: Error finding container 7bcce64a1d324e24cf1226b83df7dfda7b0d1da4a96e95f629801e7d6ebd75fb: Status 404 returned error can't find the container with id 7bcce64a1d324e24cf1226b83df7dfda7b0d1da4a96e95f629801e7d6ebd75fb
Sep 11 16:03:16.582778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.582735    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mw5w6" event={"ID":"8ef21e1a-60b6-4451-9d9b-e803dd029c4e","Type":"ContainerStarted","Data":"7bcce64a1d324e24cf1226b83df7dfda7b0d1da4a96e95f629801e7d6ebd75fb"}
Sep 11 16:03:16.584008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.583971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qnghp" event={"ID":"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb","Type":"ContainerStarted","Data":"e1dc10b09a2d01f0d5044d9a650ecbcc8f0a29c47aa2b9e3c00dbbdaa58254a3"}
Sep 11 16:03:16.585124 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.585101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sth7n" event={"ID":"0c956b3a-2e06-470b-98d9-1a9402055475","Type":"ContainerStarted","Data":"b28db5ceecd9d7f6d62110ce5277b765c625a43cfcfde64c43db358285dcd312"}
Sep 11 16:03:16.882603 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.882564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:16.981503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:16.981348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:17.548788 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:17.548753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:17.590344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:17.590297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mw5w6" event={"ID":"8ef21e1a-60b6-4451-9d9b-e803dd029c4e","Type":"ContainerStarted","Data":"a768da1c481c8211170f113c67815e02594c2296db635e825bd124202c558c16"}
Sep 11 16:03:17.590511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:17.590436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:03:17.767710 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:17.767676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:18.213922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:18.213885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:18.346053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:18.346017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:18.663675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:18.663635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:18.765108 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:18.765073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:18.843233 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:18.843190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:19.162818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:19.162776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:19.754458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:19.754419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:20.146802 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.146662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:20.531859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.531820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:20.603977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.603941    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qnghp" event={"ID":"e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb","Type":"ContainerStarted","Data":"6e9b4fea644548298fee20f42bc0358098b0af4b9c425295ac48f48fbc1916fb"}
Sep 11 16:03:20.619623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.619579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:20.623094 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.623037    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qnghp" podStartSLOduration=66.726045164 podStartE2EDuration="1m10.623021178s" totalImagesPullingTime="3.896976014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:20.622155494 +0000 UTC m=+70.884401643" watchObservedRunningTime="2026-09-11 16:03:20.623021178 +0000 UTC m=+70.885267320"
Sep 11 16:03:20.623239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.623183    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mw5w6" podStartSLOduration=70.623173874 podStartE2EDuration="1m10.623173874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:17.621336953 +0000 UTC m=+67.883583094" watchObservedRunningTime="2026-09-11 16:03:20.623173874 +0000 UTC m=+70.885420017"
Sep 11 16:03:20.760629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.760580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:20.860496 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:20.860404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:21.520507 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:21.520469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:21.520728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:21.520552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:21.521208 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:21.521181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72026b0e-d0b7-422b-b5ef-990410eae593-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:21.521352 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:21.521302    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:21.521412 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:21.521364    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls podName:72026b0e-d0b7-422b-b5ef-990410eae593 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:37.52134547 +0000 UTC m=+87.783591610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d89wq" (UID: "72026b0e-d0b7-422b-b5ef-990410eae593") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:21.563035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:21.563001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:21.776059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:21.775918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:22.156340 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.156260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:22.613002 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.612969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sth7n" event={"ID":"0c956b3a-2e06-470b-98d9-1a9402055475","Type":"ContainerStarted","Data":"1a4ccf7a1cf165cb88a22a978c9715c5a73462d871916cf1d20ca5aa62f5f9c8"}
Sep 11 16:03:22.613181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.613018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sth7n" event={"ID":"0c956b3a-2e06-470b-98d9-1a9402055475","Type":"ContainerStarted","Data":"f94288854838fd75210c7cb75b0e8acc2b4ea9abb69344ad7614454a0a5326ff"}
Sep 11 16:03:22.613181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.613099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sth7n"
Sep 11 16:03:22.636981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.636927    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sth7n" podStartSLOduration=33.47872189 podStartE2EDuration="38.636910888s" totalImagesPullingTime="5.158188998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:22.636648101 +0000 UTC m=+72.898894243" watchObservedRunningTime="2026-09-11 16:03:22.636910888 +0000 UTC m=+72.899157029"
Sep 11 16:03:22.812879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:22.812838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:23.183601 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:23.183546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:23.378065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:23.378023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:23.573211 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:23.573182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:24.347350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:24.347320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:25.027453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:25.027416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:25.531195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:25.531162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:25.627215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:25.627187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:25.989565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:25.989454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:26.158855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:26.158819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:26.226475 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:26.226442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:26.975891 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:26.975856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:27.394375 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:27.394340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:27.486780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:27.486750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:27.850422 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:27.850381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:30.804854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:30.804825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:30.906335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:30.906210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:32.617894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.617861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sth7n"
Sep 11 16:03:32.838555 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.838505    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"]
Sep 11 16:03:32.840657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.840642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:32.843782 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.843762    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 16:03:32.843998 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.843981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 16:03:32.844249 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.844232    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 16:03:32.845039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.845027    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 16:03:32.875569 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.875470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"]
Sep 11 16:03:32.912947 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.912911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e05dabcc-6112-4310-a1bf-8cf874485c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:32.912947 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.912947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjdmr\" (UniqueName: \"kubernetes.io/projected/e05dabcc-6112-4310-a1bf-8cf874485c09-kube-api-access-jjdmr\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:32.913168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.912975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05dabcc-6112-4310-a1bf-8cf874485c09-tmp\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:32.968004 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:32.967966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:33.013927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.013894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e05dabcc-6112-4310-a1bf-8cf874485c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.013927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.013926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjdmr\" (UniqueName: \"kubernetes.io/projected/e05dabcc-6112-4310-a1bf-8cf874485c09-kube-api-access-jjdmr\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.014122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.013951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05dabcc-6112-4310-a1bf-8cf874485c09-tmp\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.014388 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.014365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e05dabcc-6112-4310-a1bf-8cf874485c09-tmp\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.016652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.016627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e05dabcc-6112-4310-a1bf-8cf874485c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.043204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.043164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjdmr\" (UniqueName: \"kubernetes.io/projected/e05dabcc-6112-4310-a1bf-8cf874485c09-kube-api-access-jjdmr\") pod \"klusterlet-addon-workmgr-684888979c-b9bc5\" (UID: \"e05dabcc-6112-4310-a1bf-8cf874485c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.147409 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.147318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:33.149181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.149153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:33.283146 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.283113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:33.383121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.383090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:33.426693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.426625    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"]
Sep 11 16:03:33.429655 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:33.429627    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05dabcc_6112_4310_a1bf_8cf874485c09.slice/crio-6dfbb0bd0fb816b19e7b1288aaa92daf7fa3b8acbd2e3bebd205c1f5ff5ee7b4 WatchSource:0}: Error finding container 6dfbb0bd0fb816b19e7b1288aaa92daf7fa3b8acbd2e3bebd205c1f5ff5ee7b4: Status 404 returned error can't find the container with id 6dfbb0bd0fb816b19e7b1288aaa92daf7fa3b8acbd2e3bebd205c1f5ff5ee7b4
Sep 11 16:03:33.650102 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:33.650065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5" event={"ID":"e05dabcc-6112-4310-a1bf-8cf874485c09","Type":"ContainerStarted","Data":"6dfbb0bd0fb816b19e7b1288aaa92daf7fa3b8acbd2e3bebd205c1f5ff5ee7b4"}
Sep 11 16:03:34.188066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.188023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:34.265170 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.265124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:34.871705 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.871669    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:03:34.876687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.876658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:34.879770 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.879531    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:03:34.879770 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.879591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 16:03:34.881151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.880877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 16:03:34.881151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.880906    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 16:03:34.881151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.880957    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 16:03:34.881151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.880991    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v655g\""
Sep 11 16:03:34.881151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.881083    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:03:34.881426 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.881161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 16:03:34.887153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:34.887131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:03:35.028837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.028801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.028837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.028842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.029073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.028886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.029073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.028938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.029073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.028978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrw4q\" (UniqueName: \"kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.029073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.029047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.129981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.129896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.129981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.129950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrw4q\" (UniqueName: \"kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.130204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.129986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.130204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.130021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.130204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.130038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.130348 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.130222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.130964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.130853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.131095 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.131016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.131458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.131437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.132969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.132945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.133123 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.133100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.139436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.139415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrw4q\" (UniqueName: \"kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q\") pod \"console-68f896fb65-vk8bz\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") " pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.189491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.189451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:35.386490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.386391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:35.484054 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.484012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:03:35.488275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.488229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:35.489095 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:35.489067    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572d56ba_49ec_4aa3_99a3_0597adad5c39.slice/crio-bcaa9b5b48eb5b13f9eebc556d349c8be2c7d8b6a4573635ecddfad17089c1c1 WatchSource:0}: Error finding container bcaa9b5b48eb5b13f9eebc556d349c8be2c7d8b6a4573635ecddfad17089c1c1: Status 404 returned error can't find the container with id bcaa9b5b48eb5b13f9eebc556d349c8be2c7d8b6a4573635ecddfad17089c1c1
Sep 11 16:03:35.586910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.586775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:35.659562 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.659456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f896fb65-vk8bz" event={"ID":"572d56ba-49ec-4aa3-99a3-0597adad5c39","Type":"ContainerStarted","Data":"bcaa9b5b48eb5b13f9eebc556d349c8be2c7d8b6a4573635ecddfad17089c1c1"}
Sep 11 16:03:35.925689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:35.925583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:36.051216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.051167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:36.066900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.066865    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"]
Sep 11 16:03:36.072684 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.072654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:36.075399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.075364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 16:03:36.075578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.075374    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6nwbv\""
Sep 11 16:03:36.078590 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.078540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"]
Sep 11 16:03:36.117086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.117052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:36.139902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.139859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rlhzg\" (UID: \"ffb812fa-450a-4376-8e2c-e0617566b0e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:36.241373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.241285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rlhzg\" (UID: \"ffb812fa-450a-4376-8e2c-e0617566b0e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:36.241569 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:36.241470    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 16:03:36.241569 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:36.241553    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates podName:ffb812fa-450a-4376-8e2c-e0617566b0e6 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:36.741536137 +0000 UTC m=+87.003782282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-rlhzg" (UID: "ffb812fa-450a-4376-8e2c-e0617566b0e6") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 16:03:36.519449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.519409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:36.746624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.746585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rlhzg\" (UID: \"ffb812fa-450a-4376-8e2c-e0617566b0e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:36.749452 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.749425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ffb812fa-450a-4376-8e2c-e0617566b0e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-rlhzg\" (UID: \"ffb812fa-450a-4376-8e2c-e0617566b0e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:36.989127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:36.989026    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:37.556800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.556692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:37.559414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.559389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72026b0e-d0b7-422b-b5ef-990410eae593-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d89wq\" (UID: \"72026b0e-d0b7-422b-b5ef-990410eae593\") " pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:37.669686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.669644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5" event={"ID":"e05dabcc-6112-4310-a1bf-8cf874485c09","Type":"ContainerStarted","Data":"0c32d9660f920f1061665d635504e98d70fb1d12afc5d66b08ed93143c616152"}
Sep 11 16:03:37.670019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.669993    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:37.671828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.671808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5"
Sep 11 16:03:37.690678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.690616    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-684888979c-b9bc5" podStartSLOduration=1.578260274 podStartE2EDuration="5.69059828s" totalImagesPullingTime="4.112338006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:37.689464748 +0000 UTC m=+87.951710903" watchObservedRunningTime="2026-09-11 16:03:37.69059828 +0000 UTC m=+87.952844424"
Sep 11 16:03:37.722126 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.722095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpkn\""
Sep 11 16:03:37.728422 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.728391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d89wq"
Sep 11 16:03:37.772573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:37.772194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"]
Sep 11 16:03:37.774877 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:37.774841    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb812fa_450a_4376_8e2c_e0617566b0e6.slice/crio-d9ffbe69c63a1aee304f72559f61dd9a3ffe62d348bd6d3a3e859c99b17a2202 WatchSource:0}: Error finding container d9ffbe69c63a1aee304f72559f61dd9a3ffe62d348bd6d3a3e859c99b17a2202: Status 404 returned error can't find the container with id d9ffbe69c63a1aee304f72559f61dd9a3ffe62d348bd6d3a3e859c99b17a2202
Sep 11 16:03:38.041060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:38.040978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d89wq"]
Sep 11 16:03:38.045956 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:38.045929    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72026b0e_d0b7_422b_b5ef_990410eae593.slice/crio-393d146c0b36f70b81683e3180081d7a4b0167296eaedd5c9e435af8c3906a0b WatchSource:0}: Error finding container 393d146c0b36f70b81683e3180081d7a4b0167296eaedd5c9e435af8c3906a0b: Status 404 returned error can't find the container with id 393d146c0b36f70b81683e3180081d7a4b0167296eaedd5c9e435af8c3906a0b
Sep 11 16:03:38.676947 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:38.676909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d89wq" event={"ID":"72026b0e-d0b7-422b-b5ef-990410eae593","Type":"ContainerStarted","Data":"2fbacf9908a493ee5bdd1c82e7c27940e1cda183cbaac10ecce7ef4a8101b597"}
Sep 11 16:03:38.677105 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:38.676986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d89wq" event={"ID":"72026b0e-d0b7-422b-b5ef-990410eae593","Type":"ContainerStarted","Data":"393d146c0b36f70b81683e3180081d7a4b0167296eaedd5c9e435af8c3906a0b"}
Sep 11 16:03:38.678592 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:38.678508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg" event={"ID":"ffb812fa-450a-4376-8e2c-e0617566b0e6","Type":"ContainerStarted","Data":"d9ffbe69c63a1aee304f72559f61dd9a3ffe62d348bd6d3a3e859c99b17a2202"}
Sep 11 16:03:39.798458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.798422    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:03:39.800902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.800866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:39.804208 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.804188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.812868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.812843    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 16:03:39.813167 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.813143    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:03:39.877314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.877281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:39.879126 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn8fk\" (UniqueName: \"kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.879419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.879373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn8fk\" (UniqueName: \"kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.980604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.980530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.981258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.981225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.981379 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.981270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.981379 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.981278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.981862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.981840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.984011 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.983989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.984120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.984099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:39.990799 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:39.990775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn8fk\" (UniqueName: \"kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk\") pod \"console-59b9c7887c-zvvpx\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") " pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:40.116257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.116219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:40.400999 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.400910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:03:40.405053 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:40.405026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4633c5bb_8a30_4f1b_acb3_209d5ae14dd8.slice/crio-06ee09a6fe30f5ce29419b6ca4d4cd4029f81232008fb912dff02ade5f11c120 WatchSource:0}: Error finding container 06ee09a6fe30f5ce29419b6ca4d4cd4029f81232008fb912dff02ade5f11c120: Status 404 returned error can't find the container with id 06ee09a6fe30f5ce29419b6ca4d4cd4029f81232008fb912dff02ade5f11c120
Sep 11 16:03:40.690100 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.689996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d89wq" event={"ID":"72026b0e-d0b7-422b-b5ef-990410eae593","Type":"ContainerStarted","Data":"cdd4583b487c9e44f1439f7356c0a7f72a9efc430efc9fc69ac9280c3ac9fa17"}
Sep 11 16:03:40.691723 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.691688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg" event={"ID":"ffb812fa-450a-4376-8e2c-e0617566b0e6","Type":"ContainerStarted","Data":"8943fa561f4fcf75edfd2e25912f41efe6f49eb02d8822441a67feac7b7d6062"}
Sep 11 16:03:40.691935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.691917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:40.693873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.693841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b9c7887c-zvvpx" event={"ID":"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8","Type":"ContainerStarted","Data":"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"}
Sep 11 16:03:40.694005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.693892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b9c7887c-zvvpx" event={"ID":"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8","Type":"ContainerStarted","Data":"06ee09a6fe30f5ce29419b6ca4d4cd4029f81232008fb912dff02ade5f11c120"}
Sep 11 16:03:40.696018 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.695989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f896fb65-vk8bz" event={"ID":"572d56ba-49ec-4aa3-99a3-0597adad5c39","Type":"ContainerStarted","Data":"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"}
Sep 11 16:03:40.697960 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.697938    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg"
Sep 11 16:03:40.719431 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.719379    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-rlhzg" podStartSLOduration=2.398572451 podStartE2EDuration="4.719363183s" totalImagesPullingTime="2.320790732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:40.715364508 +0000 UTC m=+90.977610650" watchObservedRunningTime="2026-09-11 16:03:40.719363183 +0000 UTC m=+90.981609325"
Sep 11 16:03:40.773318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.773260    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b9c7887c-zvvpx" podStartSLOduration=1.773241186 podStartE2EDuration="1.773241186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:40.744895885 +0000 UTC m=+91.007142028" watchObservedRunningTime="2026-09-11 16:03:40.773241186 +0000 UTC m=+91.035487327"
Sep 11 16:03:40.773699 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:40.773669    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68f896fb65-vk8bz" podStartSLOduration=2.158356485 podStartE2EDuration="6.773660513s" totalImagesPullingTime="4.615304028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:40.770349938 +0000 UTC m=+91.032596081" watchObservedRunningTime="2026-09-11 16:03:40.773660513 +0000 UTC m=+91.035906695"
Sep 11 16:03:41.110162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.110124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:41.149138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.149098    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"]
Sep 11 16:03:41.155966 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.155928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.159037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.159008    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sg4ll\""
Sep 11 16:03:41.159388 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.159371    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 16:03:41.159573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.159494    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 16:03:41.159646 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.159593    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 16:03:41.159699 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.159650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 16:03:41.160072 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.160045    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 16:03:41.167043 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.167017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"]
Sep 11 16:03:41.210692 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.210644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:41.294232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.294167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.294465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.294325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9f489-22b5-41de-a506-30e66aa6a063-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.294465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.294408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.294593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.294493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6q2m\" (UniqueName: \"kubernetes.io/projected/f2d9f489-22b5-41de-a506-30e66aa6a063-kube-api-access-p6q2m\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.395198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.395168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.395306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.395211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6q2m\" (UniqueName: \"kubernetes.io/projected/f2d9f489-22b5-41de-a506-30e66aa6a063-kube-api-access-p6q2m\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.395306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.395258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.395419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.395323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9f489-22b5-41de-a506-30e66aa6a063-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.395471 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:41.395425    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 16:03:41.395550 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:41.395537    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls podName:f2d9f489-22b5-41de-a506-30e66aa6a063 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:41.895479278 +0000 UTC m=+92.157725428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-grjk2" (UID: "f2d9f489-22b5-41de-a506-30e66aa6a063") : secret "prometheus-operator-tls" not found
Sep 11 16:03:41.395987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.395965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9f489-22b5-41de-a506-30e66aa6a063-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.398157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.398135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.407672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.407639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6q2m\" (UniqueName: \"kubernetes.io/projected/f2d9f489-22b5-41de-a506-30e66aa6a063-kube-api-access-p6q2m\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.702238 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.702141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d89wq" event={"ID":"72026b0e-d0b7-422b-b5ef-990410eae593","Type":"ContainerStarted","Data":"8e9e18a4ed16199a831282c39748352e51ac254e5168a34d80e240b5f76b6b2f"}
Sep 11 16:03:41.723268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.723209    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d89wq" podStartSLOduration=33.536635861 podStartE2EDuration="36.723191556s" totalImagesPullingTime="3.186555695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:03:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:41.72281482 +0000 UTC m=+91.985060985" watchObservedRunningTime="2026-09-11 16:03:41.723191556 +0000 UTC m=+91.985437698"
Sep 11 16:03:41.884508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.884449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:41.899494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.899466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:41.899669 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:41.899649    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 16:03:41.899738 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:41.899726    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls podName:f2d9f489-22b5-41de-a506-30e66aa6a063 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:42.89970641 +0000 UTC m=+93.161952545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-grjk2" (UID: "f2d9f489-22b5-41de-a506-30e66aa6a063") : secret "prometheus-operator-tls" not found
Sep 11 16:03:41.985571 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:41.985467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:42.099038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.099000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:42.394040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.394007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:42.498588 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.498546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:42.906334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.906303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:42.908939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.908911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d9f489-22b5-41de-a506-30e66aa6a063-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-grjk2\" (UID: \"f2d9f489-22b5-41de-a506-30e66aa6a063\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:42.968669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:42.968622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"
Sep 11 16:03:43.180853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:43.180762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:43.241086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:43.241056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-grjk2"]
Sep 11 16:03:43.244869 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:43.244842    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d9f489_22b5_41de_a506_30e66aa6a063.slice/crio-cfef5ac7f9eb67730493a6f7eed6d4610741e398b3b9ab772b2ed6b06e3e02e3 WatchSource:0}: Error finding container cfef5ac7f9eb67730493a6f7eed6d4610741e398b3b9ab772b2ed6b06e3e02e3: Status 404 returned error can't find the container with id cfef5ac7f9eb67730493a6f7eed6d4610741e398b3b9ab772b2ed6b06e3e02e3
Sep 11 16:03:43.255771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:43.255745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:43.710173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:43.710145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2" event={"ID":"f2d9f489-22b5-41de-a506-30e66aa6a063","Type":"ContainerStarted","Data":"cfef5ac7f9eb67730493a6f7eed6d4610741e398b3b9ab772b2ed6b06e3e02e3"}
Sep 11 16:03:44.183708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:44.183672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:44.292361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:44.292332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:44.452872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:44.452756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:44.564585 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:44.564550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:45.065006 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.064964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:45.190295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.190251    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:45.190607 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.190580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:45.195378 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.195352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:45.718921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.718883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2" event={"ID":"f2d9f489-22b5-41de-a506-30e66aa6a063","Type":"ContainerStarted","Data":"9d677f38ea6b3707fd159f962e35a73e3ab82c223998aad6b98cc540b5aff32b"}
Sep 11 16:03:45.719130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.718940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2" event={"ID":"f2d9f489-22b5-41de-a506-30e66aa6a063","Type":"ContainerStarted","Data":"34e60e137e762b463655484550fc5ddc69a6b91eb8375d51ab2c5dc4bc575df2"}
Sep 11 16:03:45.722674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.722653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:03:45.744712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:45.744658    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-grjk2" podStartSLOduration=3.287291953 podStartE2EDuration="4.744642921s" totalImagesPullingTime="1.457350968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:45.743483138 +0000 UTC m=+96.005729280" watchObservedRunningTime="2026-09-11 16:03:45.744642921 +0000 UTC m=+96.006889063"
Sep 11 16:03:46.994037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:46.993995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.067827 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.067792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.296436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.296401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.498875 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.498837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.638418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.638327    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"]
Sep 11 16:03:47.640868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.640848    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.643984 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.643963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 16:03:47.644117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.643970    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 16:03:47.644981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.644963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 16:03:47.645112 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.645041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v4f9f\""
Sep 11 16:03:47.656510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.656490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.657280 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.657260    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9wt5z"]
Sep 11 16:03:47.659759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.659743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.662606 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.662588    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 16:03:47.662835 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.662818    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2mr97\""
Sep 11 16:03:47.663352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.663335    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 16:03:47.668647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.668460    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 16:03:47.670300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.669929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"]
Sep 11 16:03:47.749506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.749721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj62s\" (UniqueName: \"kubernetes.io/projected/c5a22ba7-571e-4614-be62-1d61fbaf2509-kube-api-access-jj62s\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.749721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.749721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.749721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.749721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-textfile\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.749928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.749928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.749928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-sys\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.749928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.750064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-metrics-client-ca\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.750064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.749983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjb2m\" (UniqueName: \"kubernetes.io/projected/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-api-access-zjb2m\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.750064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.750023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1ad5ff-c201-433f-be78-bd09d457e8ed-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.750064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.750048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-wtmp\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.750196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.750093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-root\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.809701 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.809667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:47.850706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1ad5ff-c201-433f-be78-bd09d457e8ed-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.850902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-wtmp\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.850902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-root\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.850902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.850902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj62s\" (UniqueName: \"kubernetes.io/projected/c5a22ba7-571e-4614-be62-1d61fbaf2509-kube-api-access-jj62s\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.850902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.850980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-textfile\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1ad5ff-c201-433f-be78-bd09d457e8ed-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-sys\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-metrics-client-ca\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjb2m\" (UniqueName: \"kubernetes.io/projected/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-api-access-zjb2m\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.851633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-root\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.851633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-sys\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.852256 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:47.851929    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:47.852177    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls podName:c5a22ba7-571e-4614-be62-1d61fbaf2509 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:48.352156152 +0000 UTC m=+98.614402289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls") pod "node-exporter-9wt5z" (UID: "c5a22ba7-571e-4614-be62-1d61fbaf2509") : secret "node-exporter-tls" not found
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:47.852824    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:03:47.853039    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls podName:8d1ad5ff-c201-433f-be78-bd09d457e8ed nodeName:}" failed. No retries permitted until 2026-09-11 16:03:48.352876293 +0000 UTC m=+98.615122420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-ckrzm" (UID: "8d1ad5ff-c201-433f-be78-bd09d457e8ed") : secret "kube-state-metrics-tls" not found
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.853216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-textfile\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.853396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.853579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.853507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-accelerators-collector-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.854003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.853620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-wtmp\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.854003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.853865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5a22ba7-571e-4614-be62-1d61fbaf2509-metrics-client-ca\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.854003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.851950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.858484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.854985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.863240 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.863215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.867491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.867466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj62s\" (UniqueName: \"kubernetes.io/projected/c5a22ba7-571e-4614-be62-1d61fbaf2509-kube-api-access-jj62s\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:47.868408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.868387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjb2m\" (UniqueName: \"kubernetes.io/projected/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-api-access-zjb2m\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:47.952138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.952035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:03:47.954619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:47.954596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"image-registry-64979dc55b-b5j85\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") " pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:03:48.240424 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.240348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4k2h9\""
Sep 11 16:03:48.247901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.247882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:03:48.355279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.355246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:48.355466 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.355321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:48.357894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.357866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5a22ba7-571e-4614-be62-1d61fbaf2509-node-exporter-tls\") pod \"node-exporter-9wt5z\" (UID: \"c5a22ba7-571e-4614-be62-1d61fbaf2509\") " pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:48.357894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.357878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1ad5ff-c201-433f-be78-bd09d457e8ed-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-ckrzm\" (UID: \"8d1ad5ff-c201-433f-be78-bd09d457e8ed\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:48.528500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.528476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:03:48.531013 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:48.530980    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173b7982_ea9c_43e7_ad7e_91cf405de255.slice/crio-256bdf22274ab5831c3acbe51e8148710acea65842e492c0123281450b53654a WatchSource:0}: Error finding container 256bdf22274ab5831c3acbe51e8148710acea65842e492c0123281450b53654a: Status 404 returned error can't find the container with id 256bdf22274ab5831c3acbe51e8148710acea65842e492c0123281450b53654a
Sep 11 16:03:48.550872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.550852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"
Sep 11 16:03:48.570898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.570877    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9wt5z"
Sep 11 16:03:48.580847 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:48.580813    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a22ba7_571e_4614_be62_1d61fbaf2509.slice/crio-ee4530c264bd2aa5eff7891d379a474a53fadba0df6d56a089926c5aede5278f WatchSource:0}: Error finding container ee4530c264bd2aa5eff7891d379a474a53fadba0df6d56a089926c5aede5278f: Status 404 returned error can't find the container with id ee4530c264bd2aa5eff7891d379a474a53fadba0df6d56a089926c5aede5278f
Sep 11 16:03:48.599358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.598444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mw5w6"
Sep 11 16:03:48.631186 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.631158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:48.733433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.733393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wt5z" event={"ID":"c5a22ba7-571e-4614-be62-1d61fbaf2509","Type":"ContainerStarted","Data":"ee4530c264bd2aa5eff7891d379a474a53fadba0df6d56a089926c5aede5278f"}
Sep 11 16:03:48.737352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.737319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" event={"ID":"173b7982-ea9c-43e7-ad7e-91cf405de255","Type":"ContainerStarted","Data":"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"}
Sep 11 16:03:48.737574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.737374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" event={"ID":"173b7982-ea9c-43e7-ad7e-91cf405de255","Type":"ContainerStarted","Data":"256bdf22274ab5831c3acbe51e8148710acea65842e492c0123281450b53654a"}
Sep 11 16:03:48.737574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.737413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:03:48.768647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.768587    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" podStartSLOduration=98.768568443 podStartE2EDuration="1m38.768568443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:48.766551608 +0000 UTC m=+99.028797744" watchObservedRunningTime="2026-09-11 16:03:48.768568443 +0000 UTC m=+99.030814585"
Sep 11 16:03:48.830846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.830776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm"]
Sep 11 16:03:48.833387 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:48.833354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1ad5ff_c201_433f_be78_bd09d457e8ed.slice/crio-bc62d4456bbcc066ba7ad4e0b267dab9bd1efd7690e54fc3e9159666ed0f1767 WatchSource:0}: Error finding container bc62d4456bbcc066ba7ad4e0b267dab9bd1efd7690e54fc3e9159666ed0f1767: Status 404 returned error can't find the container with id bc62d4456bbcc066ba7ad4e0b267dab9bd1efd7690e54fc3e9159666ed0f1767
Sep 11 16:03:48.850194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.850172    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:03:48.853339 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.853313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860419    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860402    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860600    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860608    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 16:03:48.860706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.860642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 16:03:48.861380 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.861367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p4782\""
Sep 11 16:03:48.866572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.866551    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 16:03:48.878434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.878408    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:03:48.960950 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.960912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.960971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-web-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tv62\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-kube-api-access-5tv62\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-out\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:48.961460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:48.961416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.061930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tv62\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-kube-api-access-5tv62\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.061981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-out\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-web-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.062611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.062469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.063645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.063618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065345 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-out\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065625 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-web-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065794 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.065915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.065890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.066330 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.066308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.066446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.066433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.066484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.066443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.067788 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.067767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.070839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.070812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tv62\" (UniqueName: \"kubernetes.io/projected/5e0ebd23-c194-4e3c-9d3a-842c9643b8f2-kube-api-access-5tv62\") pod \"alertmanager-main-0\" (UID: \"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.181284 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.181240    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:03:49.489361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.489332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:03:49.491082 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:49.491056    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0ebd23_c194_4e3c_9d3a_842c9643b8f2.slice/crio-3843720a6b858b33c03f15a12096ea469cfcbb35b8da8b72f40dd3baec5279aa WatchSource:0}: Error finding container 3843720a6b858b33c03f15a12096ea469cfcbb35b8da8b72f40dd3baec5279aa: Status 404 returned error can't find the container with id 3843720a6b858b33c03f15a12096ea469cfcbb35b8da8b72f40dd3baec5279aa
Sep 11 16:03:49.742709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.742551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"3843720a6b858b33c03f15a12096ea469cfcbb35b8da8b72f40dd3baec5279aa"}
Sep 11 16:03:49.743953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:49.743924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm" event={"ID":"8d1ad5ff-c201-433f-be78-bd09d457e8ed","Type":"ContainerStarted","Data":"bc62d4456bbcc066ba7ad4e0b267dab9bd1efd7690e54fc3e9159666ed0f1767"}
Sep 11 16:03:50.030667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.030600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:50.117044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.116724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:50.117044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.116831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:50.129604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.129336    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:50.135045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.135011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:50.638412 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.638359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:50.727632 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.727530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:50.751792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.751753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm" event={"ID":"8d1ad5ff-c201-433f-be78-bd09d457e8ed","Type":"ContainerStarted","Data":"3a07863643f82f6236f021e6eb8da0a7c04e10817e4ed177e23dabeb2ffea316"}
Sep 11 16:03:50.751986 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.751821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm" event={"ID":"8d1ad5ff-c201-433f-be78-bd09d457e8ed","Type":"ContainerStarted","Data":"9f4414ff6579978161a2b9019321a39adcbaaef903da856ac196f789542bf50b"}
Sep 11 16:03:50.751986 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.751852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm" event={"ID":"8d1ad5ff-c201-433f-be78-bd09d457e8ed","Type":"ContainerStarted","Data":"bbcb2ce6269b2791f400e5f31c56a9cefafaed289c578d7237de62eace01a4e9"}
Sep 11 16:03:50.756679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.756654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:03:50.775152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.775100    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-ckrzm" podStartSLOduration=2.639599495 podStartE2EDuration="3.775082213s" totalImagesPullingTime="1.135482718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:50.773083599 +0000 UTC m=+101.035329746" watchObservedRunningTime="2026-09-11 16:03:50.775082213 +0000 UTC m=+101.037328366"
Sep 11 16:03:50.810537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.810484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:50.837281 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.837241    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:03:50.897647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:50.897571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:51.003128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.003071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:51.682508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.682476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:51.757468 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.757438    2564 generic.go:356] "Generic (PLEG): container finished" podID="c5a22ba7-571e-4614-be62-1d61fbaf2509" containerID="c8ff6f7f27c178ba9fb47588ad8357e09f5dd5a5605b7613adec1e558ede5def" exitCode=0
Sep 11 16:03:51.757677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.757548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wt5z" event={"ID":"c5a22ba7-571e-4614-be62-1d61fbaf2509","Type":"ContainerDied","Data":"c8ff6f7f27c178ba9fb47588ad8357e09f5dd5a5605b7613adec1e558ede5def"}
Sep 11 16:03:51.759296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.759274    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e0ebd23-c194-4e3c-9d3a-842c9643b8f2" containerID="835b81ff425956496beacdec3f7b7ccaf7a84c731669d97045660b3554e365f7" exitCode=0
Sep 11 16:03:51.764306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.759716    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerDied","Data":"835b81ff425956496beacdec3f7b7ccaf7a84c731669d97045660b3554e365f7"}
Sep 11 16:03:51.782679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:51.782647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:52.122936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.122900    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"]
Sep 11 16:03:52.139383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.139353    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"]
Sep 11 16:03:52.139513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.139489    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.142195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.142174    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 16:03:52.142348 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.142258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 16:03:52.142348 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.142299    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2oibg1icdd6jo\""
Sep 11 16:03:52.143137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.143119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 16:03:52.143206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.143172    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 16:03:52.143206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.143123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ccj84\""
Sep 11 16:03:52.195121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-metrics-server-audit-profiles\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-client-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-tls\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa8db1a9-adc0-439c-8c09-12411e5b8b63-audit-log\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjqh\" (UniqueName: \"kubernetes.io/projected/aa8db1a9-adc0-439c-8c09-12411e5b8b63-kube-api-access-ckjqh\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.195359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.195347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-client-certs\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.295869 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.295830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-metrics-server-audit-profiles\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.295869 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.295869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-client-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.295911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-tls\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.295966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.295990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa8db1a9-adc0-439c-8c09-12411e5b8b63-audit-log\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.296032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjqh\" (UniqueName: \"kubernetes.io/projected/aa8db1a9-adc0-439c-8c09-12411e5b8b63-kube-api-access-ckjqh\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.296103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-client-certs\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.296791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.296757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa8db1a9-adc0-439c-8c09-12411e5b8b63-audit-log\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.297052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.296971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.297125 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.297113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa8db1a9-adc0-439c-8c09-12411e5b8b63-metrics-server-audit-profiles\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.298991 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.298963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-client-ca-bundle\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.299195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.299176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-client-certs\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.299296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.299277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa8db1a9-adc0-439c-8c09-12411e5b8b63-secret-metrics-server-tls\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.301879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.301855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:52.307999 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.307978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjqh\" (UniqueName: \"kubernetes.io/projected/aa8db1a9-adc0-439c-8c09-12411e5b8b63-kube-api-access-ckjqh\") pod \"metrics-server-7bd6d96b8d-tkfhx\" (UID: \"aa8db1a9-adc0-439c-8c09-12411e5b8b63\") " pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.398052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.397967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:52.449552 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.449500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:03:52.766365 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.766342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wt5z" event={"ID":"c5a22ba7-571e-4614-be62-1d61fbaf2509","Type":"ContainerStarted","Data":"3a38a7e7034aabd05b2bce763633e701678bb2c7060d6840060a7b66368e3a5a"}
Sep 11 16:03:52.766776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.766388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9wt5z" event={"ID":"c5a22ba7-571e-4614-be62-1d61fbaf2509","Type":"ContainerStarted","Data":"bcf19617131b434e2383df4673378b4962e21aefd41717be6d1dc0efd158b50c"}
Sep 11 16:03:52.767363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.767339    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"]
Sep 11 16:03:52.768630 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:52.768606    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8db1a9_adc0_439c_8c09_12411e5b8b63.slice/crio-2a6c9c9f073bfa5e903085d8fb4b8c3f46d3851d9eeeb8e9729cf80db9a8638f WatchSource:0}: Error finding container 2a6c9c9f073bfa5e903085d8fb4b8c3f46d3851d9eeeb8e9729cf80db9a8638f: Status 404 returned error can't find the container with id 2a6c9c9f073bfa5e903085d8fb4b8c3f46d3851d9eeeb8e9729cf80db9a8638f
Sep 11 16:03:52.817748 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:52.817688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9wt5z" podStartSLOduration=3.128220752 podStartE2EDuration="5.817672015s" totalImagesPullingTime="2.616378697s" totalInitContainerRuntime="73.072566ms" isStatefulPod=true podCreationTimestamp="2026-09-11 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:52.817304768 +0000 UTC m=+103.079550911" watchObservedRunningTime="2026-09-11 16:03:52.817672015 +0000 UTC m=+103.079918158"
Sep 11 16:03:53.592439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.592403    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:03:53.615296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.615262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:03:53.615470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.615422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710075 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwkp\" (UniqueName: \"kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.710588 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.710296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.719206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.719086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:53.780007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.779964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx" event={"ID":"aa8db1a9-adc0-439c-8c09-12411e5b8b63","Type":"ContainerStarted","Data":"2a6c9c9f073bfa5e903085d8fb4b8c3f46d3851d9eeeb8e9729cf80db9a8638f"}
Sep 11 16:03:53.811418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.811798 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.811717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwkp\" (UniqueName: \"kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.814570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.812720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.814570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.813654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.815323 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.815298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.815893 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.815869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.816821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.816799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.817490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.817470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.829990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.829957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:53.833577 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.833533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwkp\" (UniqueName: \"kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp\") pod \"console-584bb7f4d6-w6dr9\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") " pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:53.929046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:53.928958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:03:54.052433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.052394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:54.185216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.185131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:54.308211 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.308179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:54.755593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.755561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:03:54.763579 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:03:54.763555    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277bec0f_cba4_4d8c_9476_31fa4d412455.slice/crio-a5eb8b47628358de50c1f2213228e6cf120d9186e80bc36177dc0770565936b5 WatchSource:0}: Error finding container a5eb8b47628358de50c1f2213228e6cf120d9186e80bc36177dc0770565936b5: Status 404 returned error can't find the container with id a5eb8b47628358de50c1f2213228e6cf120d9186e80bc36177dc0770565936b5
Sep 11 16:03:54.787163 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.787124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bb7f4d6-w6dr9" event={"ID":"277bec0f-cba4-4d8c-9476-31fa4d412455","Type":"ContainerStarted","Data":"a5eb8b47628358de50c1f2213228e6cf120d9186e80bc36177dc0770565936b5"}
Sep 11 16:03:54.792015 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.791989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"d8b74009d646486124994017d259c2457a7ce82fe9f1ec6f92bc08d16914006a"}
Sep 11 16:03:54.792132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.792051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"5bd697ee03abac5fec48597d230f6d51649c66dad357634bea0a1e74156e070f"}
Sep 11 16:03:54.792132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.792088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"9d53915079d7b9d675a2693f1e5cafc3573807c8ea8677143cef03ca7f4a7234"}
Sep 11 16:03:54.792132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.792115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"01e9137f5478ac6a3bd3efa97774049c224898a4001f39e8e247f7eb898e2eeb"}
Sep 11 16:03:54.793909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.793884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx" event={"ID":"aa8db1a9-adc0-439c-8c09-12411e5b8b63","Type":"ContainerStarted","Data":"f89a97fef69cc281df7e7f93755fc7bef3a069e0c53a9ff7379f4f5da615cf75"}
Sep 11 16:03:54.814451 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:54.814402    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx" podStartSLOduration=1.101548787 podStartE2EDuration="2.814384083s" totalImagesPullingTime="1.712835296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:54.813289382 +0000 UTC m=+105.075535524" watchObservedRunningTime="2026-09-11 16:03:54.814384083 +0000 UTC m=+105.076630224"
Sep 11 16:03:55.799998 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:55.799965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bb7f4d6-w6dr9" event={"ID":"277bec0f-cba4-4d8c-9476-31fa4d412455","Type":"ContainerStarted","Data":"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"}
Sep 11 16:03:55.803112 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:55.803080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"52774197bc0b529534c6e871805d5dd139dc66e1326848817b4fa42e9c1359d1"}
Sep 11 16:03:55.820700 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:55.820647    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584bb7f4d6-w6dr9" podStartSLOduration=2.820630848 podStartE2EDuration="2.820630848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:55.819689306 +0000 UTC m=+106.081935448" watchObservedRunningTime="2026-09-11 16:03:55.820630848 +0000 UTC m=+106.082876992"
Sep 11 16:03:56.314251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.314211    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:03:56.428120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.428084    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:56.528992 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.528956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:56.603957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.603878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:03:56.809848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.809811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e0ebd23-c194-4e3c-9d3a-842c9643b8f2","Type":"ContainerStarted","Data":"3f55d9fb139cc5382bb2109b0db4331e42d715b07043b02ca324568efe9f42e0"}
Sep 11 16:03:56.855702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:03:56.855602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.939028401 podStartE2EDuration="8.855584513s" totalImagesPullingTime="5.899617723s" totalInitContainerRuntime="16.938389ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:56.852698574 +0000 UTC m=+107.114944715" watchObservedRunningTime="2026-09-11 16:03:56.855584513 +0000 UTC m=+107.117830656"
Sep 11 16:04:00.115370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:00.115337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:00.860778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:00.860741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:00.984090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:00.984046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:03.929816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:03.929771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:04:03.930322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:03.929834    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:04:03.934773 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:03.934750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:04:04.846171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:04.846145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:04:04.927384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:04.927355    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:04:05.272057 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:05.272020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:05.381602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:05.381570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:06.320575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:06.320550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:04:10.866160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:10.866129    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9f9ac78-f480-4e91-8de6-0e3ad1b45457" containerID="aea8e94fc399e30811dab88efe9da47867b0b63e903f4ddca02f1b1866da1098" exitCode=0
Sep 11 16:04:10.866538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:10.866213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wzntf" event={"ID":"f9f9ac78-f480-4e91-8de6-0e3ad1b45457","Type":"ContainerDied","Data":"aea8e94fc399e30811dab88efe9da47867b0b63e903f4ddca02f1b1866da1098"}
Sep 11 16:04:10.866605 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:10.866591    2564 scope.go:117] "RemoveContainer" containerID="aea8e94fc399e30811dab88efe9da47867b0b63e903f4ddca02f1b1866da1098"
Sep 11 16:04:11.749625 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:11.749580    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mm8md_81d531fa-cf83-4040-8b45-41e3820705c1/serve-healthcheck-canary/0.log"
Sep 11 16:04:11.872742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:11.872705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-wzntf" event={"ID":"f9f9ac78-f480-4e91-8de6-0e3ad1b45457","Type":"ContainerStarted","Data":"643df9622c568ce349b95bc3494b57320bb8bbd7188864244bbe941000078cf9"}
Sep 11 16:04:12.450598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:12.450562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:04:12.450805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:12.450637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:04:15.823186 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:15.823148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:15.864114 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:15.864069    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68f896fb65-vk8bz" podUID="572d56ba-49ec-4aa3-99a3-0597adad5c39" containerName="console" containerID="cri-o://7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb" gracePeriod=15
Sep 11 16:04:16.101465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.101440    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:04:16.222882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.222850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.222882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.222888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.223129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.222939    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrw4q\" (UniqueName: \"kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.223129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.222959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.223129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.223008    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.223129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.223023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config\") pod \"572d56ba-49ec-4aa3-99a3-0597adad5c39\" (UID: \"572d56ba-49ec-4aa3-99a3-0597adad5c39\") "
Sep 11 16:04:16.223460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.223370    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:16.223460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.223434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca" (OuterVolumeSpecName: "service-ca") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:16.223646 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.223594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config" (OuterVolumeSpecName: "console-config") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:16.225499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.225476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:16.225807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.225787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:16.225807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.225793    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q" (OuterVolumeSpecName: "kube-api-access-mrw4q") pod "572d56ba-49ec-4aa3-99a3-0597adad5c39" (UID: "572d56ba-49ec-4aa3-99a3-0597adad5c39"). InnerVolumeSpecName "kube-api-access-mrw4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:04:16.324180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324143    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrw4q\" (UniqueName: \"kubernetes.io/projected/572d56ba-49ec-4aa3-99a3-0597adad5c39-kube-api-access-mrw4q\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.324180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324170    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.324180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324179    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-oauth-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.324180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324188    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-console-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.324445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324197    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-oauth-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.324445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.324205    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572d56ba-49ec-4aa3-99a3-0597adad5c39-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:16.726766 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.726722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:16.894168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.894131    2564 generic.go:356] "Generic (PLEG): container finished" podID="572d56ba-49ec-4aa3-99a3-0597adad5c39" containerID="7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb" exitCode=0
Sep 11 16:04:16.894658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.894182    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f896fb65-vk8bz"
Sep 11 16:04:16.894658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.894218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f896fb65-vk8bz" event={"ID":"572d56ba-49ec-4aa3-99a3-0597adad5c39","Type":"ContainerDied","Data":"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"}
Sep 11 16:04:16.894658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.894271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f896fb65-vk8bz" event={"ID":"572d56ba-49ec-4aa3-99a3-0597adad5c39","Type":"ContainerDied","Data":"bcaa9b5b48eb5b13f9eebc556d349c8be2c7d8b6a4573635ecddfad17089c1c1"}
Sep 11 16:04:16.894658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.894291    2564 scope.go:117] "RemoveContainer" containerID="7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"
Sep 11 16:04:16.902534 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.902500    2564 scope.go:117] "RemoveContainer" containerID="7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"
Sep 11 16:04:16.902834 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:04:16.902813    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb\": container with ID starting with 7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb not found: ID does not exist" containerID="7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"
Sep 11 16:04:16.902914 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.902843    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb"} err="failed to get container status \"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb\": rpc error: code = NotFound desc = could not find container \"7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb\": container with ID starting with 7ecec212ad9a1bf7be5049dc9bd568724149bf354e07a73aabe712e3981cf7fb not found: ID does not exist"
Sep 11 16:04:16.913438 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.913393    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:04:16.918547 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:16.918506    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68f896fb65-vk8bz"]
Sep 11 16:04:18.285585 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:18.285550    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572d56ba-49ec-4aa3-99a3-0597adad5c39" path="/var/lib/kubelet/pods/572d56ba-49ec-4aa3-99a3-0597adad5c39/volumes"
Sep 11 16:04:20.058715 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.058672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:04:20.061256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.061233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59ab0ef8-e96a-4fab-a75d-a6713af2c11b-metrics-certs\") pod \"network-metrics-daemon-shknl\" (UID: \"59ab0ef8-e96a-4fab-a75d-a6713af2c11b\") " pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:04:20.103258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.103224    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tt876\""
Sep 11 16:04:20.110964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.110942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shknl"
Sep 11 16:04:20.384663 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.384582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shknl"]
Sep 11 16:04:20.387571 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:04:20.387546    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ab0ef8_e96a_4fab_a75d_a6713af2c11b.slice/crio-f6341bcf038943fa6d077d18625acb9bef4c662e96af406e342306f64f862a04 WatchSource:0}: Error finding container f6341bcf038943fa6d077d18625acb9bef4c662e96af406e342306f64f862a04: Status 404 returned error can't find the container with id f6341bcf038943fa6d077d18625acb9bef4c662e96af406e342306f64f862a04
Sep 11 16:04:20.912498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:20.912465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shknl" event={"ID":"59ab0ef8-e96a-4fab-a75d-a6713af2c11b","Type":"ContainerStarted","Data":"f6341bcf038943fa6d077d18625acb9bef4c662e96af406e342306f64f862a04"}
Sep 11 16:04:21.334176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.334132    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" podUID="173b7982-ea9c-43e7-ad7e-91cf405de255" containerName="registry" containerID="cri-o://c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566" gracePeriod=30
Sep 11 16:04:21.644407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.644382    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:04:21.773300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773260    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773396    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773436    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773620    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n96k\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773675    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token\") pod \"173b7982-ea9c-43e7-ad7e-91cf405de255\" (UID: \"173b7982-ea9c-43e7-ad7e-91cf405de255\") "
Sep 11 16:04:21.773895 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773817    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:21.773970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:21.774042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.773994    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-certificates\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.776698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.776648    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:04:21.777450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.777425    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:04:21.777696 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.777671    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:21.777876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.777854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:21.777947 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.777898    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k" (OuterVolumeSpecName: "kube-api-access-8n96k") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "kube-api-access-8n96k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:04:21.787847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.787801    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "173b7982-ea9c-43e7-ad7e-91cf405de255" (UID: "173b7982-ea9c-43e7-ad7e-91cf405de255"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875167    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-installation-pull-secrets\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875205    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-bound-sa-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875218    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/173b7982-ea9c-43e7-ad7e-91cf405de255-image-registry-private-configuration\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875227    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/173b7982-ea9c-43e7-ad7e-91cf405de255-ca-trust-extracted\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875237    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/173b7982-ea9c-43e7-ad7e-91cf405de255-trusted-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875245    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-registry-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.875256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.875252    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n96k\" (UniqueName: \"kubernetes.io/projected/173b7982-ea9c-43e7-ad7e-91cf405de255-kube-api-access-8n96k\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:21.918688 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.918649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shknl" event={"ID":"59ab0ef8-e96a-4fab-a75d-a6713af2c11b","Type":"ContainerStarted","Data":"04f7b0b689eda1281dccee4471ccfc3a7c2d248691ebd872d6ff15ae91ab4c81"}
Sep 11 16:04:21.918861 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.918753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shknl" event={"ID":"59ab0ef8-e96a-4fab-a75d-a6713af2c11b","Type":"ContainerStarted","Data":"e49f3218376eda0db7b3199272050b1a8d0a46eb33ccd59aaae6cc5599ad41bd"}
Sep 11 16:04:21.920373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.920120    2564 generic.go:356] "Generic (PLEG): container finished" podID="173b7982-ea9c-43e7-ad7e-91cf405de255" containerID="c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566" exitCode=0
Sep 11 16:04:21.920373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.920221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" event={"ID":"173b7982-ea9c-43e7-ad7e-91cf405de255","Type":"ContainerDied","Data":"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"}
Sep 11 16:04:21.920373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.920251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64979dc55b-b5j85" event={"ID":"173b7982-ea9c-43e7-ad7e-91cf405de255","Type":"ContainerDied","Data":"256bdf22274ab5831c3acbe51e8148710acea65842e492c0123281450b53654a"}
Sep 11 16:04:21.920373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.920271    2564 scope.go:117] "RemoveContainer" containerID="c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"
Sep 11 16:04:21.920373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.920329    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64979dc55b-b5j85"
Sep 11 16:04:21.929925 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.929909    2564 scope.go:117] "RemoveContainer" containerID="c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"
Sep 11 16:04:21.930269 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:04:21.930244    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566\": container with ID starting with c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566 not found: ID does not exist" containerID="c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"
Sep 11 16:04:21.930312 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.930286    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566"} err="failed to get container status \"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566\": rpc error: code = NotFound desc = could not find container \"c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566\": container with ID starting with c076373770ad5aed344d878b8db799aa00cb97efc7b652c6b6139bbb5f50d566 not found: ID does not exist"
Sep 11 16:04:21.945922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.945873    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-shknl" podStartSLOduration=130.797864219 podStartE2EDuration="2m11.945855546s" totalImagesPullingTime="1.147991327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:04:21.943199391 +0000 UTC m=+132.205445546" watchObservedRunningTime="2026-09-11 16:04:21.945855546 +0000 UTC m=+132.208101739"
Sep 11 16:04:21.963510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.963473    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:04:21.965690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:21.965665    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64979dc55b-b5j85"]
Sep 11 16:04:22.059576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:22.059543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:22.132357 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:22.132275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:22.285839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:22.285801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="173b7982-ea9c-43e7-ad7e-91cf405de255" path="/var/lib/kubelet/pods/173b7982-ea9c-43e7-ad7e-91cf405de255/volumes"
Sep 11 16:04:23.290681 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:23.290644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:23.449701 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:23.449673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:23.601305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:23.601210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:29.949736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:29.949674    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59b9c7887c-zvvpx" podUID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" containerName="console" containerID="cri-o://e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca" gracePeriod=15
Sep 11 16:04:30.197114 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.197083    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:04:30.346242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346206    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346245    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346343    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346705 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn8fk\" (UniqueName: \"kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk\") pod \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\" (UID: \"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8\") "
Sep 11 16:04:30.346838 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca" (OuterVolumeSpecName: "service-ca") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:30.346921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:30.346921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346865    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:30.346921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config" (OuterVolumeSpecName: "console-config") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:04:30.347069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346964    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-trusted-ca-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.347069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346984    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.347069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.346999    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-oauth-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.347069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.347013    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.348586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.348558    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:30.348773 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.348757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk" (OuterVolumeSpecName: "kube-api-access-qn8fk") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "kube-api-access-qn8fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:04:30.348773 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.348755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" (UID: "4633c5bb-8a30-4f1b-acb3-209d5ae14dd8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:04:30.447392 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.447357    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.447392 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.447386    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn8fk\" (UniqueName: \"kubernetes.io/projected/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-kube-api-access-qn8fk\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.447392 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.447398    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8-console-oauth-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:04:30.911447 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.911411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:04:30.958578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.958547    2564 generic.go:356] "Generic (PLEG): container finished" podID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" containerID="e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca" exitCode=0
Sep 11 16:04:30.958973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.958619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b9c7887c-zvvpx" event={"ID":"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8","Type":"ContainerDied","Data":"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"}
Sep 11 16:04:30.958973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.958666    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b9c7887c-zvvpx" event={"ID":"4633c5bb-8a30-4f1b-acb3-209d5ae14dd8","Type":"ContainerDied","Data":"06ee09a6fe30f5ce29419b6ca4d4cd4029f81232008fb912dff02ade5f11c120"}
Sep 11 16:04:30.958973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.958675    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b9c7887c-zvvpx"
Sep 11 16:04:30.958973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.958693    2564 scope.go:117] "RemoveContainer" containerID="e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"
Sep 11 16:04:30.967342 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.967323    2564 scope.go:117] "RemoveContainer" containerID="e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"
Sep 11 16:04:30.967654 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:04:30.967636    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca\": container with ID starting with e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca not found: ID does not exist" containerID="e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"
Sep 11 16:04:30.967722 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.967664    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca"} err="failed to get container status \"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca\": rpc error: code = NotFound desc = could not find container \"e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca\": container with ID starting with e1e1d4b41891b0e03b77d2d4608fd1c6dc3ddbe030742cfa2de9a77547b5bdca not found: ID does not exist"
Sep 11 16:04:30.982992 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.982971    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:04:30.987356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:30.987333    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b9c7887c-zvvpx"]
Sep 11 16:04:32.285510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:32.285477    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" path="/var/lib/kubelet/pods/4633c5bb-8a30-4f1b-acb3-209d5ae14dd8/volumes"
Sep 11 16:04:32.455341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:32.455309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:04:32.459097 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:32.459073    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bd6d96b8d-tkfhx"
Sep 11 16:04:32.816219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:04:32.816185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:06.951454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:06.951368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:07.608473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:07.608435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:11.205341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:11.205306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:11.307049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:11.307007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:12.053689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.053652    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57459847cf-m2qp5"]
Sep 11 16:05:12.054020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054004    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" containerName="console"
Sep 11 16:05:12.054020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054022    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" containerName="console"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054041    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572d56ba-49ec-4aa3-99a3-0597adad5c39" containerName="console"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="572d56ba-49ec-4aa3-99a3-0597adad5c39" containerName="console"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054054    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173b7982-ea9c-43e7-ad7e-91cf405de255" containerName="registry"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054061    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="173b7982-ea9c-43e7-ad7e-91cf405de255" containerName="registry"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054107    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="173b7982-ea9c-43e7-ad7e-91cf405de255" containerName="registry"
Sep 11 16:05:12.054117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054116    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4633c5bb-8a30-4f1b-acb3-209d5ae14dd8" containerName="console"
Sep 11 16:05:12.054293 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.054121    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="572d56ba-49ec-4aa3-99a3-0597adad5c39" containerName="console"
Sep 11 16:05:12.058621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.058605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.061430 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-khtnz\""
Sep 11 16:05:12.061634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 16:05:12.061816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 16:05:12.061901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 16:05:12.061901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061540    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 16:05:12.062008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.061677    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 16:05:12.065838 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.065819    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 16:05:12.069931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.069909    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57459847cf-m2qp5"]
Sep 11 16:05:12.166192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-metrics-client-ca\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-federate-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-serving-certs-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.166709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.166510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbf5s\" (UniqueName: \"kubernetes.io/projected/3c3dfd99-6e22-4696-9f42-51cc4c624be0-kube-api-access-vbf5s\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.267748 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.267715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.267767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.267792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-metrics-client-ca\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.267964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-federate-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-serving-certs-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbf5s\" (UniqueName: \"kubernetes.io/projected/3c3dfd99-6e22-4696-9f42-51cc4c624be0-kube-api-access-vbf5s\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268849 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-serving-certs-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268955 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268850    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.268955 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.268822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c3dfd99-6e22-4696-9f42-51cc4c624be0-metrics-client-ca\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.270727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.270698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-federate-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.270727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.270722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.270866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.270781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-secret-telemeter-client\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.271185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.271160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c3dfd99-6e22-4696-9f42-51cc4c624be0-telemeter-client-tls\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.276582 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.276564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbf5s\" (UniqueName: \"kubernetes.io/projected/3c3dfd99-6e22-4696-9f42-51cc4c624be0-kube-api-access-vbf5s\") pod \"telemeter-client-57459847cf-m2qp5\" (UID: \"3c3dfd99-6e22-4696-9f42-51cc4c624be0\") " pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.372118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.372033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5"
Sep 11 16:05:12.655670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:12.655647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57459847cf-m2qp5"]
Sep 11 16:05:12.657843 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:05:12.657807    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3dfd99_6e22_4696_9f42_51cc4c624be0.slice/crio-a4c1dce4628e3ed7ac36a645b5a9cb36aea13b73a95910a15e06a78b20633634 WatchSource:0}: Error finding container a4c1dce4628e3ed7ac36a645b5a9cb36aea13b73a95910a15e06a78b20633634: Status 404 returned error can't find the container with id a4c1dce4628e3ed7ac36a645b5a9cb36aea13b73a95910a15e06a78b20633634
Sep 11 16:05:13.122721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:13.122683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5" event={"ID":"3c3dfd99-6e22-4696-9f42-51cc4c624be0","Type":"ContainerStarted","Data":"a4c1dce4628e3ed7ac36a645b5a9cb36aea13b73a95910a15e06a78b20633634"}
Sep 11 16:05:15.133588 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.133544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5" event={"ID":"3c3dfd99-6e22-4696-9f42-51cc4c624be0","Type":"ContainerStarted","Data":"afa0f0b3a55e8a1b47b77c6d0e7d977e359dd7a5e2e2c529324455609e92d49a"}
Sep 11 16:05:15.133965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.133611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5" event={"ID":"3c3dfd99-6e22-4696-9f42-51cc4c624be0","Type":"ContainerStarted","Data":"de7cae2398cd3b1a7cb7ca5cb5356b85f6b8e19efbf3e7fb21807a61cfc62b68"}
Sep 11 16:05:15.133965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.133641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5" event={"ID":"3c3dfd99-6e22-4696-9f42-51cc4c624be0","Type":"ContainerStarted","Data":"32935beab802b9999395b055de6a297797eec74dcdfe149a46e5b459e930d4b9"}
Sep 11 16:05:15.157291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.157225    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57459847cf-m2qp5" podStartSLOduration=1.405182589 podStartE2EDuration="3.157204397s" totalImagesPullingTime="1.752021808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:05:15.156570863 +0000 UTC m=+185.418817005" watchObservedRunningTime="2026-09-11 16:05:15.157204397 +0000 UTC m=+185.419450539"
Sep 11 16:05:15.240837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.240801    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:15.244652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.244621    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.260672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.260640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:15.293871 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.293843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szh9x\" (UniqueName: \"kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.293879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.293902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.293954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.294038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.294063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.294200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.294080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.304658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.304623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:15.394834 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szh9x\" (UniqueName: \"kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.394973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.395592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395892 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.395588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.395892 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.395665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.396387 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.396360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.397616 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.397591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.397702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.397683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.404214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.404196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szh9x\" (UniqueName: \"kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x\") pod \"console-6b87c7f7f5-72xf2\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") " pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.554488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.554433    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:15.832224 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:15.832135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:15.834860 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:05:15.834829    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5a5277_5084_41eb_845f_067744c2c13b.slice/crio-5b1ee02b74e495006bf519a6b48ce7246c4ceac7e44427c39a12a151bb0c55f0 WatchSource:0}: Error finding container 5b1ee02b74e495006bf519a6b48ce7246c4ceac7e44427c39a12a151bb0c55f0: Status 404 returned error can't find the container with id 5b1ee02b74e495006bf519a6b48ce7246c4ceac7e44427c39a12a151bb0c55f0
Sep 11 16:05:16.139862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:16.139770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87c7f7f5-72xf2" event={"ID":"0c5a5277-5084-41eb-845f-067744c2c13b","Type":"ContainerStarted","Data":"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"}
Sep 11 16:05:16.139862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:16.139829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87c7f7f5-72xf2" event={"ID":"0c5a5277-5084-41eb-845f-067744c2c13b","Type":"ContainerStarted","Data":"5b1ee02b74e495006bf519a6b48ce7246c4ceac7e44427c39a12a151bb0c55f0"}
Sep 11 16:05:16.163885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:16.163827    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b87c7f7f5-72xf2" podStartSLOduration=1.163808311 podStartE2EDuration="1.163808311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:05:16.161455324 +0000 UTC m=+186.423701466" watchObservedRunningTime="2026-09-11 16:05:16.163808311 +0000 UTC m=+186.426054452"
Sep 11 16:05:22.296145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:22.296096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:22.367959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:22.367924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:25.555037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.554973    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:25.555580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.555099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:25.559947 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.559925    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:25.759564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.759533    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:25.805581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.805479    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:05:25.809162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.809145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.820008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.819982    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:05:25.884108 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jxz\" (UniqueName: \"kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.884453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.884330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jxz\" (UniqueName: \"kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.985726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.985693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.986389 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.986359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.986510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.986420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.986510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.986448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.986689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.986654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.988121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.988096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.988246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.988221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:25.996311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:25.996286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jxz\" (UniqueName: \"kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz\") pod \"console-85fc8998f4-5qhdk\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") " pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:26.117736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:26.117638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:26.194611 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:26.194580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:26.398140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:26.398116    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:05:26.400809 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:05:26.400780    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576985e9_0005_4a2c_a2f9_c3e06a69e429.slice/crio-61cd21d1df997bf1e6cfb39cb76de77e01a7fa89968e7268b6f86c4ece9bcbde WatchSource:0}: Error finding container 61cd21d1df997bf1e6cfb39cb76de77e01a7fa89968e7268b6f86c4ece9bcbde: Status 404 returned error can't find the container with id 61cd21d1df997bf1e6cfb39cb76de77e01a7fa89968e7268b6f86c4ece9bcbde
Sep 11 16:05:27.196103 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:27.196070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc8998f4-5qhdk" event={"ID":"576985e9-0005-4a2c-a2f9-c3e06a69e429","Type":"ContainerStarted","Data":"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"}
Sep 11 16:05:27.196542 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:27.196118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc8998f4-5qhdk" event={"ID":"576985e9-0005-4a2c-a2f9-c3e06a69e429","Type":"ContainerStarted","Data":"61cd21d1df997bf1e6cfb39cb76de77e01a7fa89968e7268b6f86c4ece9bcbde"}
Sep 11 16:05:27.218200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:27.218140    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85fc8998f4-5qhdk" podStartSLOduration=2.218123938 podStartE2EDuration="2.218123938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:05:27.216739614 +0000 UTC m=+197.478985769" watchObservedRunningTime="2026-09-11 16:05:27.218123938 +0000 UTC m=+197.480370080"
Sep 11 16:05:34.150328 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:34.150291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:34.212251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:34.212220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:36.118743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.118693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:36.119147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.118779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:36.123589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.123565    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:36.234456 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.234424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:05:36.289514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.289485    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:05:36.405570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.405458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:36.668488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.668402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:36.745726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:36.745691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:41.869002 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:41.868967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:42.704381 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:42.704342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:45.964256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:45.964213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:46.032026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:46.031979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:05:52.215301 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.215242    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b87c7f7f5-72xf2" podUID="0c5a5277-5084-41eb-845f-067744c2c13b" containerName="console" containerID="cri-o://8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06" gracePeriod=15
Sep 11 16:05:52.457783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.457755    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:52.521675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521641    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szh9x\" (UniqueName: \"kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521747    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.521916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.521871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config\") pod \"0c5a5277-5084-41eb-845f-067744c2c13b\" (UID: \"0c5a5277-5084-41eb-845f-067744c2c13b\") "
Sep 11 16:05:52.522198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.522163    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:05:52.522741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.522715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:05:52.522878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.522773    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:05:52.522878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.522812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config" (OuterVolumeSpecName: "console-config") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:05:52.524115 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.524084    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x" (OuterVolumeSpecName: "kube-api-access-szh9x") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "kube-api-access-szh9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:05:52.524226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.524116    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:05:52.524716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.524696    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c5a5277-5084-41eb-845f-067744c2c13b" (UID: "0c5a5277-5084-41eb-845f-067744c2c13b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:05:52.622971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622933    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-trusted-ca-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.622971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622961    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szh9x\" (UniqueName: \"kubernetes.io/projected/0c5a5277-5084-41eb-845f-067744c2c13b-kube-api-access-szh9x\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.622971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622972    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.622971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622981    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.623242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622989    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-console-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.623242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.622998    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c5a5277-5084-41eb-845f-067744c2c13b-oauth-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:52.623242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:52.623006    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c5a5277-5084-41eb-845f-067744c2c13b-console-oauth-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:05:53.297226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.297188    2564 generic.go:356] "Generic (PLEG): container finished" podID="0c5a5277-5084-41eb-845f-067744c2c13b" containerID="8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06" exitCode=0
Sep 11 16:05:53.297658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.297252    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b87c7f7f5-72xf2"
Sep 11 16:05:53.297658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.297280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87c7f7f5-72xf2" event={"ID":"0c5a5277-5084-41eb-845f-067744c2c13b","Type":"ContainerDied","Data":"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"}
Sep 11 16:05:53.297658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.297331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b87c7f7f5-72xf2" event={"ID":"0c5a5277-5084-41eb-845f-067744c2c13b","Type":"ContainerDied","Data":"5b1ee02b74e495006bf519a6b48ce7246c4ceac7e44427c39a12a151bb0c55f0"}
Sep 11 16:05:53.297658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.297351    2564 scope.go:117] "RemoveContainer" containerID="8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"
Sep 11 16:05:53.308852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.308833    2564 scope.go:117] "RemoveContainer" containerID="8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"
Sep 11 16:05:53.309156 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:05:53.309139    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06\": container with ID starting with 8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06 not found: ID does not exist" containerID="8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"
Sep 11 16:05:53.309202 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.309167    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06"} err="failed to get container status \"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06\": rpc error: code = NotFound desc = could not find container \"8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06\": container with ID starting with 8c032374621c4157a2e488ba15afc1a63cd621afd736a17cd6086dcda857dc06 not found: ID does not exist"
Sep 11 16:05:53.321512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.321481    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:53.323997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:53.323973    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b87c7f7f5-72xf2"]
Sep 11 16:05:54.284830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:05:54.284801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5a5277-5084-41eb-845f-067744c2c13b" path="/var/lib/kubelet/pods/0c5a5277-5084-41eb-845f-067744c2c13b/volumes"
Sep 11 16:06:01.309537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.309485    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-584bb7f4d6-w6dr9" podUID="277bec0f-cba4-4d8c-9476-31fa4d412455" containerName="console" containerID="cri-o://7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1" gracePeriod=15
Sep 11 16:06:01.567427 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.567371    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:06:01.706063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706068    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706101    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706153    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcwkp\" (UniqueName: \"kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706223    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706262    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert\") pod \"277bec0f-cba4-4d8c-9476-31fa4d412455\" (UID: \"277bec0f-cba4-4d8c-9476-31fa4d412455\") "
Sep 11 16:06:01.706510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:06:01.706608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706552    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca" (OuterVolumeSpecName: "service-ca") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:06:01.706608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706576    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config" (OuterVolumeSpecName: "console-config") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:06:01.706810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.706788    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:06:01.708394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.708362    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:06:01.708514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.708445    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:06:01.708595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.708504    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp" (OuterVolumeSpecName: "kube-api-access-xcwkp") pod "277bec0f-cba4-4d8c-9476-31fa4d412455" (UID: "277bec0f-cba4-4d8c-9476-31fa4d412455"). InnerVolumeSpecName "kube-api-access-xcwkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:06:01.807076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807019    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807069    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-trusted-ca-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807081    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807091    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-console-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807103    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcwkp\" (UniqueName: \"kubernetes.io/projected/277bec0f-cba4-4d8c-9476-31fa4d412455-kube-api-access-xcwkp\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807114    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/277bec0f-cba4-4d8c-9476-31fa4d412455-console-oauth-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:01.807390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:01.807126    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/277bec0f-cba4-4d8c-9476-31fa4d412455-oauth-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:02.333341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.333288    2564 generic.go:356] "Generic (PLEG): container finished" podID="277bec0f-cba4-4d8c-9476-31fa4d412455" containerID="7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1" exitCode=0
Sep 11 16:06:02.333341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.333342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bb7f4d6-w6dr9" event={"ID":"277bec0f-cba4-4d8c-9476-31fa4d412455","Type":"ContainerDied","Data":"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"}
Sep 11 16:06:02.333819 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.333346    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584bb7f4d6-w6dr9"
Sep 11 16:06:02.333819 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.333381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584bb7f4d6-w6dr9" event={"ID":"277bec0f-cba4-4d8c-9476-31fa4d412455","Type":"ContainerDied","Data":"a5eb8b47628358de50c1f2213228e6cf120d9186e80bc36177dc0770565936b5"}
Sep 11 16:06:02.333819 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.333401    2564 scope.go:117] "RemoveContainer" containerID="7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"
Sep 11 16:06:02.341864 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.341842    2564 scope.go:117] "RemoveContainer" containerID="7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"
Sep 11 16:06:02.342197 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:06:02.342179    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1\": container with ID starting with 7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1 not found: ID does not exist" containerID="7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"
Sep 11 16:06:02.342248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.342207    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1"} err="failed to get container status \"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1\": rpc error: code = NotFound desc = could not find container \"7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1\": container with ID starting with 7f1398984f482ca217af4af949372e50ad4ad41c4036c49042236ab9eeb16ce1 not found: ID does not exist"
Sep 11 16:06:02.348142 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.348107    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:06:02.351204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:02.351180    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584bb7f4d6-w6dr9"]
Sep 11 16:06:04.285372 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:04.285339    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="277bec0f-cba4-4d8c-9476-31fa4d412455" path="/var/lib/kubelet/pods/277bec0f-cba4-4d8c-9476-31fa4d412455/volumes"
Sep 11 16:06:29.622828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:29.622782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:29.718243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:29.718207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:30.735575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735540    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"]
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735831    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5a5277-5084-41eb-845f-067744c2c13b" containerName="console"
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735842    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5a5277-5084-41eb-845f-067744c2c13b" containerName="console"
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735859    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277bec0f-cba4-4d8c-9476-31fa4d412455" containerName="console"
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735864    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="277bec0f-cba4-4d8c-9476-31fa4d412455" containerName="console"
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735918    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="277bec0f-cba4-4d8c-9476-31fa4d412455" containerName="console"
Sep 11 16:06:30.735973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.735928    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5a5277-5084-41eb-845f-067744c2c13b" containerName="console"
Sep 11 16:06:30.738913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.738896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.741622 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.741593    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:06:30.742414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.742393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6w2f\""
Sep 11 16:06:30.742414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.742404    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:06:30.749595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.749574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"]
Sep 11 16:06:30.759157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.759127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.759264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.759242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.759311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.759293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2w27\" (UniqueName: \"kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.860019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.859937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.860019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.859983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2w27\" (UniqueName: \"kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.860275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.860030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.860344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.860331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.860398 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.860363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:30.869891 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:30.869868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2w27\" (UniqueName: \"kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:31.047969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:31.047939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:31.320355 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:31.320326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"]
Sep 11 16:06:31.322877 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:06:31.322848    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf535595f_ad55_4d30_99c8_7a55af3c5b97.slice/crio-72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa WatchSource:0}: Error finding container 72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa: Status 404 returned error can't find the container with id 72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa
Sep 11 16:06:31.444013 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:31.443977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5" event={"ID":"f535595f-ad55-4d30-99c8-7a55af3c5b97","Type":"ContainerStarted","Data":"72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa"}
Sep 11 16:06:39.479314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:39.479275    2564 generic.go:356] "Generic (PLEG): container finished" podID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerID="32d0df53ce30fb228b5b267bc0e68fb72a48fdfb6a38c71385996362e4d7f1af" exitCode=0
Sep 11 16:06:39.479750 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:39.479356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5" event={"ID":"f535595f-ad55-4d30-99c8-7a55af3c5b97","Type":"ContainerDied","Data":"32d0df53ce30fb228b5b267bc0e68fb72a48fdfb6a38c71385996362e4d7f1af"}
Sep 11 16:06:42.494369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:42.494332    2564 generic.go:356] "Generic (PLEG): container finished" podID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerID="2f2beaa3e180ea3b083a0ee9764d4a244bf29c416d9ff9bf2ec0ed03ac43e06e" exitCode=0
Sep 11 16:06:42.494841 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:42.494412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5" event={"ID":"f535595f-ad55-4d30-99c8-7a55af3c5b97","Type":"ContainerDied","Data":"2f2beaa3e180ea3b083a0ee9764d4a244bf29c416d9ff9bf2ec0ed03ac43e06e"}
Sep 11 16:06:43.946582 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:43.946504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:50.132290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:50.132246    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:50.234868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:50.234778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:50.532012 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:50.531978    2564 generic.go:356] "Generic (PLEG): container finished" podID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerID="8ed902fa8aee500d2a00f88db80d3fde64ec07cdbba3427a851f73469bd4cdad" exitCode=0
Sep 11 16:06:50.532219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:50.532037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5" event={"ID":"f535595f-ad55-4d30-99c8-7a55af3c5b97","Type":"ContainerDied","Data":"8ed902fa8aee500d2a00f88db80d3fde64ec07cdbba3427a851f73469bd4cdad"}
Sep 11 16:06:51.658974 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.658947    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:51.738953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.738915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util\") pod \"f535595f-ad55-4d30-99c8-7a55af3c5b97\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") "
Sep 11 16:06:51.738953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.738969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2w27\" (UniqueName: \"kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27\") pod \"f535595f-ad55-4d30-99c8-7a55af3c5b97\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") "
Sep 11 16:06:51.739216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.739055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle\") pod \"f535595f-ad55-4d30-99c8-7a55af3c5b97\" (UID: \"f535595f-ad55-4d30-99c8-7a55af3c5b97\") "
Sep 11 16:06:51.739783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.739752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle" (OuterVolumeSpecName: "bundle") pod "f535595f-ad55-4d30-99c8-7a55af3c5b97" (UID: "f535595f-ad55-4d30-99c8-7a55af3c5b97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:06:51.741370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.741339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27" (OuterVolumeSpecName: "kube-api-access-x2w27") pod "f535595f-ad55-4d30-99c8-7a55af3c5b97" (UID: "f535595f-ad55-4d30-99c8-7a55af3c5b97"). InnerVolumeSpecName "kube-api-access-x2w27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:06:51.743624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.743602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util" (OuterVolumeSpecName: "util") pod "f535595f-ad55-4d30-99c8-7a55af3c5b97" (UID: "f535595f-ad55-4d30-99c8-7a55af3c5b97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:06:51.840460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.840370    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:51.840460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.840400    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f535595f-ad55-4d30-99c8-7a55af3c5b97-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:51.840460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:51.840409    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2w27\" (UniqueName: \"kubernetes.io/projected/f535595f-ad55-4d30-99c8-7a55af3c5b97-kube-api-access-x2w27\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:06:52.541780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:52.541742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5" event={"ID":"f535595f-ad55-4d30-99c8-7a55af3c5b97","Type":"ContainerDied","Data":"72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa"}
Sep 11 16:06:52.541940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:52.541795    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72f4c712fbb6b67e797964f2bbb3ab6703931a7ca9e76f7d198acae65943f1aa"
Sep 11 16:06:52.541940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:52.541754    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrzl5"
Sep 11 16:06:56.896674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:56.896638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:57.706846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:57.706810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:06:58.806998 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.806963    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"]
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807268    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="util"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807278    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="util"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807292    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="extract"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807297    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="extract"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807307    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="pull"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807314    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="pull"
Sep 11 16:06:58.807414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.807359    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f535595f-ad55-4d30-99c8-7a55af3c5b97" containerName="extract"
Sep 11 16:06:58.809372 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.809352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:58.813253 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.813228    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 16:06:58.813491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.813476    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:06:58.813605 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.813533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wflvq\""
Sep 11 16:06:58.837398 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.837373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"]
Sep 11 16:06:58.895783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.895750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8lcg\" (UniqueName: \"kubernetes.io/projected/011eb76b-c4db-4764-a281-fbc7d208919a-kube-api-access-d8lcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:58.895968 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.895847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/011eb76b-c4db-4764-a281-fbc7d208919a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:58.996664 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.996627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/011eb76b-c4db-4764-a281-fbc7d208919a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:58.996829 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.996678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8lcg\" (UniqueName: \"kubernetes.io/projected/011eb76b-c4db-4764-a281-fbc7d208919a-kube-api-access-d8lcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:58.996992 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:58.996970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/011eb76b-c4db-4764-a281-fbc7d208919a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:59.008759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:59.008725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8lcg\" (UniqueName: \"kubernetes.io/projected/011eb76b-c4db-4764-a281-fbc7d208919a-kube-api-access-d8lcg\") pod \"cert-manager-operator-controller-manager-55c444bf86-8zl5t\" (UID: \"011eb76b-c4db-4764-a281-fbc7d208919a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:59.118623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:59.118538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"
Sep 11 16:06:59.405206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:59.405183    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t"]
Sep 11 16:06:59.407236 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:06:59.407203    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011eb76b_c4db_4764_a281_fbc7d208919a.slice/crio-acd012d8ab80d9c2d1eecaa51485276c2668d77d997f4ad52a310d1d1d85b66a WatchSource:0}: Error finding container acd012d8ab80d9c2d1eecaa51485276c2668d77d997f4ad52a310d1d1d85b66a: Status 404 returned error can't find the container with id acd012d8ab80d9c2d1eecaa51485276c2668d77d997f4ad52a310d1d1d85b66a
Sep 11 16:06:59.571735 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:06:59.571701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t" event={"ID":"011eb76b-c4db-4764-a281-fbc7d208919a","Type":"ContainerStarted","Data":"acd012d8ab80d9c2d1eecaa51485276c2668d77d997f4ad52a310d1d1d85b66a"}
Sep 11 16:07:00.461729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:00.461686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:00.562232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:00.562191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:01.583172 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:01.583137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t" event={"ID":"011eb76b-c4db-4764-a281-fbc7d208919a","Type":"ContainerStarted","Data":"b3ee27336105efe593299a1ee841f788604958bc17a9041c8c389ca0f4567556"}
Sep 11 16:07:01.617533 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:01.617472    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8zl5t" podStartSLOduration=1.79695152 podStartE2EDuration="3.617453284s" totalImagesPullingTime="1.820501764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:01.615872099 +0000 UTC m=+291.878118266" watchObservedRunningTime="2026-09-11 16:07:01.617453284 +0000 UTC m=+291.879699426"
Sep 11 16:07:02.174583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.174543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:02.423571 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.423505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:02.582432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.582389    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gwrng"]
Sep 11 16:07:02.585754 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.585727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.592563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.592453    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mcndn\""
Sep 11 16:07:02.592841 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.592816    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 16:07:02.594813 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.594792    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 16:07:02.610593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.610550    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gwrng"]
Sep 11 16:07:02.732231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.732190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.732413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.732373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8g6\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-kube-api-access-xj8g6\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.833391 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.833301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8g6\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-kube-api-access-xj8g6\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.833391 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.833381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.873213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.873175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.873351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.873271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8g6\" (UniqueName: \"kubernetes.io/projected/abbd5e40-2772-4d15-b481-b24b2c453955-kube-api-access-xj8g6\") pod \"cert-manager-webhook-6486ffd997-gwrng\" (UID: \"abbd5e40-2772-4d15-b481-b24b2c453955\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:02.907017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:02.906981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:03.289810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.289695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gwrng"]
Sep 11 16:07:03.292483 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:03.292457    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabbd5e40_2772_4d15_b481_b24b2c453955.slice/crio-a0ff7e5e7243b8d8d1e53b87e38d2d50dfc2804a2b96c430d63052196b827560 WatchSource:0}: Error finding container a0ff7e5e7243b8d8d1e53b87e38d2d50dfc2804a2b96c430d63052196b827560: Status 404 returned error can't find the container with id a0ff7e5e7243b8d8d1e53b87e38d2d50dfc2804a2b96c430d63052196b827560
Sep 11 16:07:03.391504 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.391466    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"]
Sep 11 16:07:03.396239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.396215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.401463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.401438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6w2f\""
Sep 11 16:07:03.402299 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.402280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:07:03.402380 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.402280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:07:03.417073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.417039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"]
Sep 11 16:07:03.540261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.540164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.540261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.540215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.540261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.540243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhxh\" (UniqueName: \"kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.593346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.593309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng" event={"ID":"abbd5e40-2772-4d15-b481-b24b2c453955","Type":"ContainerStarted","Data":"a0ff7e5e7243b8d8d1e53b87e38d2d50dfc2804a2b96c430d63052196b827560"}
Sep 11 16:07:03.640921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.640879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.641128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.640935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.641128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.640971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhxh\" (UniqueName: \"kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.641355 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.641332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.641355 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.641351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.661883 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.661848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhxh\" (UniqueName: \"kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.705889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.705853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:03.998951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:03.998925    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"]
Sep 11 16:07:04.001873 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:04.001843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3db340f_9a01_4a83_90ba_60c9e2a8cbaf.slice/crio-d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21 WatchSource:0}: Error finding container d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21: Status 404 returned error can't find the container with id d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21
Sep 11 16:07:04.311358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:04.311318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:04.601288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:04.601186    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerID="bf9438db8a338ec4323fa49dc5342c540264d6a9fff1d119173e19638aa3fead" exitCode=0
Sep 11 16:07:04.601288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:04.601274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl" event={"ID":"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf","Type":"ContainerDied","Data":"bf9438db8a338ec4323fa49dc5342c540264d6a9fff1d119173e19638aa3fead"}
Sep 11 16:07:04.601812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:04.601334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl" event={"ID":"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf","Type":"ContainerStarted","Data":"d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21"}
Sep 11 16:07:04.728823 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:04.728786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:06.615786 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:06.615745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng" event={"ID":"abbd5e40-2772-4d15-b481-b24b2c453955","Type":"ContainerStarted","Data":"9a235cd85c255903ee4ad5fab615e07e315c3cd1fcee34a788e3b52b5edd3dc9"}
Sep 11 16:07:06.616207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:06.616022    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:06.634615 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:06.634556    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng" podStartSLOduration=2.018103823 podStartE2EDuration="4.634538139s" totalImagesPullingTime="2.616434316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:06.632374092 +0000 UTC m=+296.894620235" watchObservedRunningTime="2026-09-11 16:07:06.634538139 +0000 UTC m=+296.896784277"
Sep 11 16:07:07.240594 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:07.240563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:07.342877 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:07.342849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:07.622921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:07.622891    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerID="fcd8a445569b947d3772c5e4c937634f17fe1c10684b6b45da9d7d372161e9e1" exitCode=0
Sep 11 16:07:07.623353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:07.622965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl" event={"ID":"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf","Type":"ContainerDied","Data":"fcd8a445569b947d3772c5e4c937634f17fe1c10684b6b45da9d7d372161e9e1"}
Sep 11 16:07:08.630282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:08.630247    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerID="f007390825b1e4a5a2d6554fb22d2fc234f4c58b42ee207d45f6678f2957ed5f" exitCode=0
Sep 11 16:07:08.630702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:08.630357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl" event={"ID":"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf","Type":"ContainerDied","Data":"f007390825b1e4a5a2d6554fb22d2fc234f4c58b42ee207d45f6678f2957ed5f"}
Sep 11 16:07:09.769219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.769187    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:09.896662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.896579    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle\") pod \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") "
Sep 11 16:07:09.896662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.896629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzhxh\" (UniqueName: \"kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh\") pod \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") "
Sep 11 16:07:09.896872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.896682    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util\") pod \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\" (UID: \"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf\") "
Sep 11 16:07:09.897059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.897034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle" (OuterVolumeSpecName: "bundle") pod "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" (UID: "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:09.898879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.898854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh" (OuterVolumeSpecName: "kube-api-access-tzhxh") pod "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" (UID: "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf"). InnerVolumeSpecName "kube-api-access-tzhxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:07:09.903106 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.903081    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util" (OuterVolumeSpecName: "util") pod "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" (UID: "c3db340f-9a01-4a83-90ba-60c9e2a8cbaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:09.997413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.997374    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:09.997413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.997404    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzhxh\" (UniqueName: \"kubernetes.io/projected/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-kube-api-access-tzhxh\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:09.997413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:09.997414    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3db340f-9a01-4a83-90ba-60c9e2a8cbaf-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:10.173385 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.173311    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:07:10.173558 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.173510    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:07:10.180431 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.180409    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 16:07:10.641130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.641100    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl"
Sep 11 16:07:10.641347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.641101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk4hpl" event={"ID":"c3db340f-9a01-4a83-90ba-60c9e2a8cbaf","Type":"ContainerDied","Data":"d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21"}
Sep 11 16:07:10.641347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:10.641226    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d59920d43b6ae10f5e29080220c0b83fa0a9790f9c1e02e9bc4f77f70d34ab21"
Sep 11 16:07:12.266642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:12.266610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:12.625838 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:12.625750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gwrng"
Sep 11 16:07:12.859178 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:12.859144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:12.944645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:12.944549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:13.646980 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.646944    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sg79m"]
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647267    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="pull"
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647281    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="pull"
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647291    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="extract"
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647297    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="extract"
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647312    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="util"
Sep 11 16:07:13.647352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647317    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="util"
Sep 11 16:07:13.647586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.647372    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3db340f-9a01-4a83-90ba-60c9e2a8cbaf" containerName="extract"
Sep 11 16:07:13.651398 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.651377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.653854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.653834    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kz47x\""
Sep 11 16:07:13.660045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.660022    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sg79m"]
Sep 11 16:07:13.731454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.731418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fqd\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-kube-api-access-89fqd\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.731662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.731475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-bound-sa-token\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.832536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.832486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-bound-sa-token\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.832747 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.832575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fqd\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-kube-api-access-89fqd\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.841796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.841764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-bound-sa-token\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.841933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.841856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fqd\" (UniqueName: \"kubernetes.io/projected/ce725bd2-d6b0-4860-9629-e8d651f47311-kube-api-access-89fqd\") pod \"cert-manager-55b4d954d5-sg79m\" (UID: \"ce725bd2-d6b0-4860-9629-e8d651f47311\") " pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:13.961734 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:13.961650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sg79m"
Sep 11 16:07:14.236062 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.235981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sg79m"]
Sep 11 16:07:14.238882 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:14.238843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce725bd2_d6b0_4860_9629_e8d651f47311.slice/crio-afc46f47040519b527efec8a104ced73bc8f1b4cffad5069dd2c4a4566db6ce5 WatchSource:0}: Error finding container afc46f47040519b527efec8a104ced73bc8f1b4cffad5069dd2c4a4566db6ce5: Status 404 returned error can't find the container with id afc46f47040519b527efec8a104ced73bc8f1b4cffad5069dd2c4a4566db6ce5
Sep 11 16:07:14.660994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.660965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sg79m" event={"ID":"ce725bd2-d6b0-4860-9629-e8d651f47311","Type":"ContainerStarted","Data":"7684223edbaf61dbe5c0c95f446f2d64430adf963e434274c6e4e365fa43d516"}
Sep 11 16:07:14.660994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.661001    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sg79m" event={"ID":"ce725bd2-d6b0-4860-9629-e8d651f47311","Type":"ContainerStarted","Data":"afc46f47040519b527efec8a104ced73bc8f1b4cffad5069dd2c4a4566db6ce5"}
Sep 11 16:07:14.682361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.682312    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-sg79m" podStartSLOduration=1.6822962590000001 podStartE2EDuration="1.682296259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:14.679906262 +0000 UTC m=+304.942152405" watchObservedRunningTime="2026-09-11 16:07:14.682296259 +0000 UTC m=+304.944542400"
Sep 11 16:07:14.725601 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.725555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:14.826987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:14.826942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:16.566293 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.566257    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"]
Sep 11 16:07:16.568552 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.568511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.571742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.571720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cmpfx\""
Sep 11 16:07:16.571866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.571727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:07:16.572065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.572049    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 16:07:16.580084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.580055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"]
Sep 11 16:07:16.659976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.659948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065da93-e741-44de-840c-cbeda23dfb99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.660172 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.660021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtpq\" (UniqueName: \"kubernetes.io/projected/5065da93-e741-44de-840c-cbeda23dfb99-kube-api-access-txtpq\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.765982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.761249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtpq\" (UniqueName: \"kubernetes.io/projected/5065da93-e741-44de-840c-cbeda23dfb99-kube-api-access-txtpq\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.765982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.761372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065da93-e741-44de-840c-cbeda23dfb99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.765982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.761856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5065da93-e741-44de-840c-cbeda23dfb99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.770506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.770480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtpq\" (UniqueName: \"kubernetes.io/projected/5065da93-e741-44de-840c-cbeda23dfb99-kube-api-access-txtpq\") pod \"openshift-lws-operator-fd8ccff4c-wn5fr\" (UID: \"5065da93-e741-44de-840c-cbeda23dfb99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:16.878724 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:16.878628    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"
Sep 11 16:07:17.154238 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:17.154119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr"]
Sep 11 16:07:17.156446 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:17.156411    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5065da93_e741_44de_840c_cbeda23dfb99.slice/crio-5bf6351b823a1278390f6c55e456c1f937f5f5debb0a7a5f93094106f41ffcfd WatchSource:0}: Error finding container 5bf6351b823a1278390f6c55e456c1f937f5f5debb0a7a5f93094106f41ffcfd: Status 404 returned error can't find the container with id 5bf6351b823a1278390f6c55e456c1f937f5f5debb0a7a5f93094106f41ffcfd
Sep 11 16:07:17.158299 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:17.158277    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:07:17.252294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:17.252254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:17.675494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:17.675463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr" event={"ID":"5065da93-e741-44de-840c-cbeda23dfb99","Type":"ContainerStarted","Data":"5bf6351b823a1278390f6c55e456c1f937f5f5debb0a7a5f93094106f41ffcfd"}
Sep 11 16:07:20.693171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:20.693132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr" event={"ID":"5065da93-e741-44de-840c-cbeda23dfb99","Type":"ContainerStarted","Data":"0ebfaa213633c54bf76c2ab6d89496e0c554a10763fdb7de9cef87bedb20f841"}
Sep 11 16:07:20.710062 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:20.710015    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wn5fr" podStartSLOduration=2.06390291 podStartE2EDuration="4.709998557s" totalImagesPullingTime="2.646095647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:20.709128535 +0000 UTC m=+310.971374672" watchObservedRunningTime="2026-09-11 16:07:20.709998557 +0000 UTC m=+310.972244698"
Sep 11 16:07:21.423344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:21.423310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:21.524489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:21.524454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:22.879657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.879617    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"]
Sep 11 16:07:22.882056 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.882039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:22.885223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.885195    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6w2f\""
Sep 11 16:07:22.885344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.885229    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:07:22.885344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.885268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:07:22.892643 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:22.892610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"]
Sep 11 16:07:23.019181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.019144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.019346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.019188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.019346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.019276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzv2\" (UniqueName: \"kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.120390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.120355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.120553 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.120414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzv2\" (UniqueName: \"kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.120553 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.120467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.120764 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.120742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.120824 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.120804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.130378 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.130320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzv2\" (UniqueName: \"kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.191073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.191038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:23.472220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.472197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"]
Sep 11 16:07:23.474133 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:23.474103    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266f8410_4ac4_42a1_80e2_42e1f6208cb8.slice/crio-fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a WatchSource:0}: Error finding container fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a: Status 404 returned error can't find the container with id fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a
Sep 11 16:07:23.499830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.499802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:23.708256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.708216    2564 generic.go:356] "Generic (PLEG): container finished" podID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerID="c076b8f82b26a69da3fd6bc944de9373944ea22ab3bb360b5343e36ea9e9b50b" exitCode=0
Sep 11 16:07:23.708423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.708286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn" event={"ID":"266f8410-4ac4-42a1-80e2-42e1f6208cb8","Type":"ContainerDied","Data":"c076b8f82b26a69da3fd6bc944de9373944ea22ab3bb360b5343e36ea9e9b50b"}
Sep 11 16:07:23.708423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:23.708341    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn" event={"ID":"266f8410-4ac4-42a1-80e2-42e1f6208cb8","Type":"ContainerStarted","Data":"fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a"}
Sep 11 16:07:24.715583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:24.715476    2564 generic.go:356] "Generic (PLEG): container finished" podID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerID="6750d31f82804c89f663c6b6f56cead156ad277d3ad3332ff0837911ef1dbd25" exitCode=0
Sep 11 16:07:24.715583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:24.715556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn" event={"ID":"266f8410-4ac4-42a1-80e2-42e1f6208cb8","Type":"ContainerDied","Data":"6750d31f82804c89f663c6b6f56cead156ad277d3ad3332ff0837911ef1dbd25"}
Sep 11 16:07:25.722130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:25.722093    2564 generic.go:356] "Generic (PLEG): container finished" podID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerID="8ebf9497723e1616258ee82dfdca2f8cb9fdb81e47cb2c2c32735be8f9eeee8b" exitCode=0
Sep 11 16:07:25.722493 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:25.722177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn" event={"ID":"266f8410-4ac4-42a1-80e2-42e1f6208cb8","Type":"ContainerDied","Data":"8ebf9497723e1616258ee82dfdca2f8cb9fdb81e47cb2c2c32735be8f9eeee8b"}
Sep 11 16:07:26.856263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.856238    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:26.953615 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.953574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhzv2\" (UniqueName: \"kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2\") pod \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") "
Sep 11 16:07:26.953810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.953642    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util\") pod \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") "
Sep 11 16:07:26.954140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.954124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle\") pod \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\" (UID: \"266f8410-4ac4-42a1-80e2-42e1f6208cb8\") "
Sep 11 16:07:26.954981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.954952    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle" (OuterVolumeSpecName: "bundle") pod "266f8410-4ac4-42a1-80e2-42e1f6208cb8" (UID: "266f8410-4ac4-42a1-80e2-42e1f6208cb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:26.956351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.956329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2" (OuterVolumeSpecName: "kube-api-access-lhzv2") pod "266f8410-4ac4-42a1-80e2-42e1f6208cb8" (UID: "266f8410-4ac4-42a1-80e2-42e1f6208cb8"). InnerVolumeSpecName "kube-api-access-lhzv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:07:26.959616 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:26.959589    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util" (OuterVolumeSpecName: "util") pod "266f8410-4ac4-42a1-80e2-42e1f6208cb8" (UID: "266f8410-4ac4-42a1-80e2-42e1f6208cb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:27.055498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.055465    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhzv2\" (UniqueName: \"kubernetes.io/projected/266f8410-4ac4-42a1-80e2-42e1f6208cb8-kube-api-access-lhzv2\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:27.055498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.055495    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:27.055498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.055505    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/266f8410-4ac4-42a1-80e2-42e1f6208cb8-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:27.732855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.732824    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn"
Sep 11 16:07:27.732855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.732847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzzskn" event={"ID":"266f8410-4ac4-42a1-80e2-42e1f6208cb8","Type":"ContainerDied","Data":"fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a"}
Sep 11 16:07:27.733052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:27.732891    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc2eefe222fa2b24eeb13027b19a5780d6b336b6efc6c6347af1e959f983a22a"
Sep 11 16:07:35.155807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.155770    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"]
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156088    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="pull"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156104    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="pull"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156113    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="util"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156118    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="util"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156133    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="extract"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156139    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="extract"
Sep 11 16:07:35.156361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.156238    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="266f8410-4ac4-42a1-80e2-42e1f6208cb8" containerName="extract"
Sep 11 16:07:35.158733 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.158707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.161600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.161568    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:07:35.162767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.162745    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6w2f\""
Sep 11 16:07:35.162860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.162751    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:07:35.172231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.172200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"]
Sep 11 16:07:35.223788 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.223754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.223949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.223796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rdzd\" (UniqueName: \"kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.223996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.223950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.285584 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.285542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:35.324821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.324789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.324982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.324832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.324982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.324852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rdzd\" (UniqueName: \"kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.325216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.325195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.325216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.325209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.337612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.337582    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rdzd\" (UniqueName: \"kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.469090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.469005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:35.746953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.746927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"]
Sep 11 16:07:35.748409 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:35.748384    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed7f9a6_c3b1_4167_9978_94c004ed56ba.slice/crio-3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14 WatchSource:0}: Error finding container 3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14: Status 404 returned error can't find the container with id 3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14
Sep 11 16:07:35.771358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:35.771329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856" event={"ID":"9ed7f9a6-c3b1-4167-9978-94c004ed56ba","Type":"ContainerStarted","Data":"3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14"}
Sep 11 16:07:36.729667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.729592    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"]
Sep 11 16:07:36.731951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.731932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.737634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.737607    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 16:07:36.737634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.737620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rngc9\""
Sep 11 16:07:36.738088 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.737697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 16:07:36.738088 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.737959    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 16:07:36.739601 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.739581    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 16:07:36.776951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.776914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"]
Sep 11 16:07:36.779171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.779142    2564 generic.go:356] "Generic (PLEG): container finished" podID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerID="1b3693a9f1cfaab8f28fb37ac894235c47f6af092c9fe473dcfd683cd7d6a459" exitCode=0
Sep 11 16:07:36.779297 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.779231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856" event={"ID":"9ed7f9a6-c3b1-4167-9978-94c004ed56ba","Type":"ContainerDied","Data":"1b3693a9f1cfaab8f28fb37ac894235c47f6af092c9fe473dcfd683cd7d6a459"}
Sep 11 16:07:36.838907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.838879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.838907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.838909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvt6h\" (UniqueName: \"kubernetes.io/projected/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-kube-api-access-zvt6h\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.839110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.839028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.839110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.839076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.839183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.839108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvt6h\" (UniqueName: \"kubernetes.io/projected/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-kube-api-access-zvt6h\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.940729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.940705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.942859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.942836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.943062 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.943045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.943192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.943172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:36.952637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:36.952606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvt6h\" (UniqueName: \"kubernetes.io/projected/b3ece49f-abe0-4ce6-9a25-877c954f4bd4-kube-api-access-zvt6h\") pod \"opendatahub-operator-controller-manager-58649dcd54-6bzfr\" (UID: \"b3ece49f-abe0-4ce6-9a25-877c954f4bd4\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:37.001960 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.001826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.042961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.042923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:37.099247 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.099220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.197240 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.197205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.296946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.296916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.322029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.321981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"]
Sep 11 16:07:37.324403 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:37.324375    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ece49f_abe0_4ce6_9a25_877c954f4bd4.slice/crio-2f50dbfccba6a0298853857d2264a19aa18f2fc02d4d84d28660f6503a0d4fed WatchSource:0}: Error finding container 2f50dbfccba6a0298853857d2264a19aa18f2fc02d4d84d28660f6503a0d4fed: Status 404 returned error can't find the container with id 2f50dbfccba6a0298853857d2264a19aa18f2fc02d4d84d28660f6503a0d4fed
Sep 11 16:07:37.384727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.384693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.516477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.516434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:37.784929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.784898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerStarted","Data":"2f50dbfccba6a0298853857d2264a19aa18f2fc02d4d84d28660f6503a0d4fed"}
Sep 11 16:07:37.786906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.786881    2564 generic.go:356] "Generic (PLEG): container finished" podID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerID="566adbbd29cda62d7d4d4a50ad895fb9d29b6874fad43c47e93fd8a4d0ba8a96" exitCode=0
Sep 11 16:07:37.787021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:37.786936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856" event={"ID":"9ed7f9a6-c3b1-4167-9978-94c004ed56ba","Type":"ContainerDied","Data":"566adbbd29cda62d7d4d4a50ad895fb9d29b6874fad43c47e93fd8a4d0ba8a96"}
Sep 11 16:07:38.796381 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:38.796344    2564 generic.go:356] "Generic (PLEG): container finished" podID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerID="428e291e7b05f10305f34885820ea6e2a5f76174ed6812734ebfe66bd2e2f2ac" exitCode=0
Sep 11 16:07:38.796817 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:38.796406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856" event={"ID":"9ed7f9a6-c3b1-4167-9978-94c004ed56ba","Type":"ContainerDied","Data":"428e291e7b05f10305f34885820ea6e2a5f76174ed6812734ebfe66bd2e2f2ac"}
Sep 11 16:07:40.615536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.615494    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:40.672800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.672764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util\") pod \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") "
Sep 11 16:07:40.672800 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.672806    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle\") pod \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") "
Sep 11 16:07:40.673039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.672860    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rdzd\" (UniqueName: \"kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd\") pod \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\" (UID: \"9ed7f9a6-c3b1-4167-9978-94c004ed56ba\") "
Sep 11 16:07:40.673727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.673687    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle" (OuterVolumeSpecName: "bundle") pod "9ed7f9a6-c3b1-4167-9978-94c004ed56ba" (UID: "9ed7f9a6-c3b1-4167-9978-94c004ed56ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:40.675660 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.675509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd" (OuterVolumeSpecName: "kube-api-access-2rdzd") pod "9ed7f9a6-c3b1-4167-9978-94c004ed56ba" (UID: "9ed7f9a6-c3b1-4167-9978-94c004ed56ba"). InnerVolumeSpecName "kube-api-access-2rdzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:07:40.678994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.678969    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util" (OuterVolumeSpecName: "util") pod "9ed7f9a6-c3b1-4167-9978-94c004ed56ba" (UID: "9ed7f9a6-c3b1-4167-9978-94c004ed56ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:07:40.774229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.774188    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:40.774229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.774221    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:40.774229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.774230    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rdzd\" (UniqueName: \"kubernetes.io/projected/9ed7f9a6-c3b1-4167-9978-94c004ed56ba-kube-api-access-2rdzd\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:07:40.809750 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.809706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerStarted","Data":"9fe39d2812c4875411f2ded0c07cb5f1b2ba019f83110c77f4115e94130db84c"}
Sep 11 16:07:40.811662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.811628    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856" event={"ID":"9ed7f9a6-c3b1-4167-9978-94c004ed56ba","Type":"ContainerDied","Data":"3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14"}
Sep 11 16:07:40.811805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.811669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l2856"
Sep 11 16:07:40.811805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:40.811680    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b413fe0ab5813cf1f18dc1f96ae150657c78e659134ed1c6eaab497019f1d14"
Sep 11 16:07:42.823235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:42.823199    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3ece49f-abe0-4ce6-9a25-877c954f4bd4" containerID="9fe39d2812c4875411f2ded0c07cb5f1b2ba019f83110c77f4115e94130db84c" exitCode=0
Sep 11 16:07:42.823655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:42.823258    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerDied","Data":"9fe39d2812c4875411f2ded0c07cb5f1b2ba019f83110c77f4115e94130db84c"}
Sep 11 16:07:43.829586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:43.829550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerStarted","Data":"9f7d51faac0725d6eca0b2fbfe9ed57a493fd9726a0ce900c4e016e8ef7a8de9"}
Sep 11 16:07:43.829971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:43.829776    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:43.852379 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:43.852289    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" podStartSLOduration=2.969890861 podStartE2EDuration="7.852268383s" totalImagesPullingTime="3.709132897s" totalInitContainerRuntime="1.173244625s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:43.851405042 +0000 UTC m=+334.113651185" watchObservedRunningTime="2026-09-11 16:07:43.852268383 +0000 UTC m=+334.114514526"
Sep 11 16:07:45.742948 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:45.742888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:45.854994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:45.854951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:48.362963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:48.362920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:54.836906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:54.836873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:07:56.461385 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.461343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:56.553954 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.553916    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"]
Sep 11 16:07:56.554396 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554369    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="extract"
Sep 11 16:07:56.554396 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554392    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="extract"
Sep 11 16:07:56.554575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554409    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="pull"
Sep 11 16:07:56.554575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554414    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="pull"
Sep 11 16:07:56.554575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554430    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="util"
Sep 11 16:07:56.554575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554435    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="util"
Sep 11 16:07:56.554575 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.554497    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ed7f9a6-c3b1-4167-9978-94c004ed56ba" containerName="extract"
Sep 11 16:07:56.563465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.563419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.568655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.568632    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 16:07:56.568792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.568634    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 16:07:56.568792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.568634    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lwq8b\""
Sep 11 16:07:56.568792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.568726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 16:07:56.579482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.579451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"]
Sep 11 16:07:56.681409 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.681374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:56.715997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.715907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.716162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.715990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4267f86-3680-4b26-9a72-9cc6d3556ade-manager-config\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.716162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.716061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.716162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.716095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqhq\" (UniqueName: \"kubernetes.io/projected/b4267f86-3680-4b26-9a72-9cc6d3556ade-kube-api-access-9hqhq\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.817313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.817283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.817313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.817319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4267f86-3680-4b26-9a72-9cc6d3556ade-manager-config\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.817596 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.817347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.817596 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.817364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqhq\" (UniqueName: \"kubernetes.io/projected/b4267f86-3680-4b26-9a72-9cc6d3556ade-kube-api-access-9hqhq\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.818164 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.818137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4267f86-3680-4b26-9a72-9cc6d3556ade-manager-config\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.819913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.819881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.820079 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.820057    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4267f86-3680-4b26-9a72-9cc6d3556ade-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.849145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.849116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqhq\" (UniqueName: \"kubernetes.io/projected/b4267f86-3680-4b26-9a72-9cc6d3556ade-kube-api-access-9hqhq\") pod \"lws-controller-manager-7d9ffdf556-49tqr\" (UID: \"b4267f86-3680-4b26-9a72-9cc6d3556ade\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.873023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.872994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:07:56.882009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:56.881976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:57.008281 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.008254    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"]
Sep 11 16:07:57.013113 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.013094    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.018639 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.018615    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 16:07:57.018756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.018627    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 16:07:57.019069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.019046    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 16:07:57.019191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.019115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q2qbx\""
Sep 11 16:07:57.019670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.019652    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 16:07:57.037490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.037464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"]
Sep 11 16:07:57.074488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.074449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:57.119846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.119813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tmp\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.119846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.119852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tls-certs\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.120065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.119901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l89m\" (UniqueName: \"kubernetes.io/projected/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-kube-api-access-8l89m\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.181704 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.181679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"]
Sep 11 16:07:57.184038 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:57.184012    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4267f86_3680_4b26_9a72_9cc6d3556ade.slice/crio-868580c4ab71b98edd1adafc1451fa0aab6acf9234a72fe537630a82f5fa15a8 WatchSource:0}: Error finding container 868580c4ab71b98edd1adafc1451fa0aab6acf9234a72fe537630a82f5fa15a8: Status 404 returned error can't find the container with id 868580c4ab71b98edd1adafc1451fa0aab6acf9234a72fe537630a82f5fa15a8
Sep 11 16:07:57.221311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.221271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l89m\" (UniqueName: \"kubernetes.io/projected/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-kube-api-access-8l89m\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.221506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.221371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tmp\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.221506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.221406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tls-certs\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.223926 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.223894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tmp\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.224076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.224060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-tls-certs\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.230335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.230311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l89m\" (UniqueName: \"kubernetes.io/projected/9ad36943-0fe9-4ffc-b371-3c7f3ad81411-kube-api-access-8l89m\") pod \"kube-auth-proxy-5864499db4-dbf4x\" (UID: \"9ad36943-0fe9-4ffc-b371-3c7f3ad81411\") " pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.325910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.325810    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"
Sep 11 16:07:57.599854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.599829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5864499db4-dbf4x"]
Sep 11 16:07:57.601568 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:07:57.601536    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad36943_0fe9_4ffc_b371_3c7f3ad81411.slice/crio-e4159881e8463fce66410df2928dda1493678c2cee840244a95ed02444ff375a WatchSource:0}: Error finding container e4159881e8463fce66410df2928dda1493678c2cee840244a95ed02444ff375a: Status 404 returned error can't find the container with id e4159881e8463fce66410df2928dda1493678c2cee840244a95ed02444ff375a
Sep 11 16:07:57.906104 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.906006    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x" event={"ID":"9ad36943-0fe9-4ffc-b371-3c7f3ad81411","Type":"ContainerStarted","Data":"e4159881e8463fce66410df2928dda1493678c2cee840244a95ed02444ff375a"}
Sep 11 16:07:57.907214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:57.907190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr" event={"ID":"b4267f86-3680-4b26-9a72-9cc6d3556ade","Type":"ContainerStarted","Data":"868580c4ab71b98edd1adafc1451fa0aab6acf9234a72fe537630a82f5fa15a8"}
Sep 11 16:07:58.912941 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:58.908991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:07:58.996712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:07:58.996672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:00.109850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.109810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:00.925779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.925739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x" event={"ID":"9ad36943-0fe9-4ffc-b371-3c7f3ad81411","Type":"ContainerStarted","Data":"157952dc58200d2a4558450e60ef52425fc4b7e9e71622db95f260781f057cba"}
Sep 11 16:08:00.927320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.927282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr" event={"ID":"b4267f86-3680-4b26-9a72-9cc6d3556ade","Type":"ContainerStarted","Data":"1c903f5ab1c7ee59cddb20af2d801c5510c73d0353d64ce5b6d3df69bf5bb49b"}
Sep 11 16:08:00.927455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.927414    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:08:00.943587 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.943504    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5864499db4-dbf4x" podStartSLOduration=1.767139 podStartE2EDuration="4.94348666s" totalImagesPullingTime="3.17634766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:00.942501437 +0000 UTC m=+351.204747598" watchObservedRunningTime="2026-09-11 16:08:00.94348666 +0000 UTC m=+351.205732827"
Sep 11 16:08:00.961008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:00.960941    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr" podStartSLOduration=1.422292558 podStartE2EDuration="4.960916949s" totalImagesPullingTime="3.538624391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:00.960278926 +0000 UTC m=+351.222525070" watchObservedRunningTime="2026-09-11 16:08:00.960916949 +0000 UTC m=+351.223163091"
Sep 11 16:08:04.033989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:04.033958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:04.133386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:04.133349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:04.324499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:04.324400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:04.560236 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:04.560193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:04.657638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:04.657536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:07.704315 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:07.704280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:07.805752 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:07.805710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:07.909463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:07.909428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:08.010508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:08.010467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:08.258503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:08.258467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:08.543193 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:08.543159    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:11.935250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:11.935222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-49tqr"
Sep 11 16:08:18.166533 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:18.166468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:18.310806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:18.310767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:18.440208 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:18.440100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:18.597760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:18.597724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:19.632216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:19.632158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:19.740593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:19.740542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:38.724330 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.724295    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd4fd98c8-2xwkg"]
Sep 11 16:08:38.728441 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.728421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802601 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-oauth-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-service-ca\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-trusted-ca-bundle\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802978 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-oauth-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.802978 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.802891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9qz\" (UniqueName: \"kubernetes.io/projected/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-kube-api-access-2j9qz\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.826538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.826476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4fd98c8-2xwkg"]
Sep 11 16:08:38.863996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.863962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:38.904230 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904230 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-trusted-ca-bundle\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-oauth-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9qz\" (UniqueName: \"kubernetes.io/projected/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-kube-api-access-2j9qz\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-oauth-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.904459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.904413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-service-ca\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.905152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.905125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-service-ca\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.905257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.905161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-trusted-ca-bundle\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.905257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.905149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.905343 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.905164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-oauth-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.906987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.906965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-serving-cert\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.907074 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.907024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-console-oauth-config\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.915108 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.915089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9qz\" (UniqueName: \"kubernetes.io/projected/a949f935-cf1a-4b22-bf0b-abfa877d4cd3-kube-api-access-2j9qz\") pod \"console-7dd4fd98c8-2xwkg\" (UID: \"a949f935-cf1a-4b22-bf0b-abfa877d4cd3\") " pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:38.965749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:38.965704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:39.038054 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:39.038020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:39.314957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:39.314934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4fd98c8-2xwkg"]
Sep 11 16:08:39.316222 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:08:39.316184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda949f935_cf1a_4b22_bf0b_abfa877d4cd3.slice/crio-834a38641d9417a75b76f5eff222182b8a37067c2030ef94353953e50b4002cc WatchSource:0}: Error finding container 834a38641d9417a75b76f5eff222182b8a37067c2030ef94353953e50b4002cc: Status 404 returned error can't find the container with id 834a38641d9417a75b76f5eff222182b8a37067c2030ef94353953e50b4002cc
Sep 11 16:08:40.128110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:40.128075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4fd98c8-2xwkg" event={"ID":"a949f935-cf1a-4b22-bf0b-abfa877d4cd3","Type":"ContainerStarted","Data":"9c2d77250a0339c22213d3d8b87fae075afca39bfa1e1f455abc9dd4f60a9f39"}
Sep 11 16:08:40.128513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:40.128138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4fd98c8-2xwkg" event={"ID":"a949f935-cf1a-4b22-bf0b-abfa877d4cd3","Type":"ContainerStarted","Data":"834a38641d9417a75b76f5eff222182b8a37067c2030ef94353953e50b4002cc"}
Sep 11 16:08:40.160831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:40.160771    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd4fd98c8-2xwkg" podStartSLOduration=2.160751238 podStartE2EDuration="2.160751238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:40.157809854 +0000 UTC m=+390.420055996" watchObservedRunningTime="2026-09-11 16:08:40.160751238 +0000 UTC m=+390.422997379"
Sep 11 16:08:42.794425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:42.794383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:42.900311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:42.900275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:49.038720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.038604    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:49.038720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.038679    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:49.043636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.043613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:49.174615 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.174587    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd4fd98c8-2xwkg"
Sep 11 16:08:49.258657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.258624    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:08:49.460718 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.460623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:08:49.651821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:08:49.651781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:08.555838 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:08.555798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:08.793314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:08.793274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:10.361547 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:10.361477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:10.539063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:10.539019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:14.284650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.284593    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85fc8998f4-5qhdk" podUID="576985e9-0005-4a2c-a2f9-c3e06a69e429" containerName="console" containerID="cri-o://5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41" gracePeriod=15
Sep 11 16:09:14.529820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.529792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:09:14.620471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2jxz\" (UniqueName: \"kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620556    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.620761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config\") pod \"576985e9-0005-4a2c-a2f9-c3e06a69e429\" (UID: \"576985e9-0005-4a2c-a2f9-c3e06a69e429\") "
Sep 11 16:09:14.621061 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca" (OuterVolumeSpecName: "service-ca") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:09:14.621128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.620996    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:09:14.621178 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.621126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:09:14.621178 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.621158    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config" (OuterVolumeSpecName: "console-config") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:09:14.623221 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.623179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:09:14.623346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.623252    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:09:14.623346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.623280    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz" (OuterVolumeSpecName: "kube-api-access-b2jxz") pod "576985e9-0005-4a2c-a2f9-c3e06a69e429" (UID: "576985e9-0005-4a2c-a2f9-c3e06a69e429"). InnerVolumeSpecName "kube-api-access-b2jxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:09:14.722234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722186    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722229    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722240    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-trusted-ca-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722250    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2jxz\" (UniqueName: \"kubernetes.io/projected/576985e9-0005-4a2c-a2f9-c3e06a69e429-kube-api-access-b2jxz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722259    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-oauth-serving-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722267    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/576985e9-0005-4a2c-a2f9-c3e06a69e429-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:14.722503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:14.722274    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/576985e9-0005-4a2c-a2f9-c3e06a69e429-console-oauth-config\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:15.302934 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.302896    2564 generic.go:356] "Generic (PLEG): container finished" podID="576985e9-0005-4a2c-a2f9-c3e06a69e429" containerID="5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41" exitCode=0
Sep 11 16:09:15.303370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.302953    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fc8998f4-5qhdk"
Sep 11 16:09:15.303370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.302982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc8998f4-5qhdk" event={"ID":"576985e9-0005-4a2c-a2f9-c3e06a69e429","Type":"ContainerDied","Data":"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"}
Sep 11 16:09:15.303370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.303039    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fc8998f4-5qhdk" event={"ID":"576985e9-0005-4a2c-a2f9-c3e06a69e429","Type":"ContainerDied","Data":"61cd21d1df997bf1e6cfb39cb76de77e01a7fa89968e7268b6f86c4ece9bcbde"}
Sep 11 16:09:15.303370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.303065    2564 scope.go:117] "RemoveContainer" containerID="5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"
Sep 11 16:09:15.312954 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.312935    2564 scope.go:117] "RemoveContainer" containerID="5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"
Sep 11 16:09:15.313223 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:09:15.313201    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41\": container with ID starting with 5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41 not found: ID does not exist" containerID="5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"
Sep 11 16:09:15.313264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.313235    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41"} err="failed to get container status \"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41\": rpc error: code = NotFound desc = could not find container \"5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41\": container with ID starting with 5b4c9189948cb8fff86cbaa38888f493b3d6c0dafc54171e54f54fbfecbdbf41 not found: ID does not exist"
Sep 11 16:09:15.339665 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.339628    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:09:15.344737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:15.344711    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fc8998f4-5qhdk"]
Sep 11 16:09:16.285917 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:16.285881    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576985e9-0005-4a2c-a2f9-c3e06a69e429" path="/var/lib/kubelet/pods/576985e9-0005-4a2c-a2f9-c3e06a69e429/volumes"
Sep 11 16:09:17.447095 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.447064    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"]
Sep 11 16:09:17.447508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.447428    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576985e9-0005-4a2c-a2f9-c3e06a69e429" containerName="console"
Sep 11 16:09:17.447508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.447442    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="576985e9-0005-4a2c-a2f9-c3e06a69e429" containerName="console"
Sep 11 16:09:17.447617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.447551    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="576985e9-0005-4a2c-a2f9-c3e06a69e429" containerName="console"
Sep 11 16:09:17.452215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.452194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.456248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.456230    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:09:17.456353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.456285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g6w2f\""
Sep 11 16:09:17.457060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.457041    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:09:17.483063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.483034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"]
Sep 11 16:09:17.548232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.548183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzzv\" (UniqueName: \"kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.548400 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.548314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.548400 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.548372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.584505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.584470    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"]
Sep 11 16:09:17.588148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.588128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.615545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.615494    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"]
Sep 11 16:09:17.649787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.649757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.649990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.649800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.649990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.649840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzzv\" (UniqueName: \"kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.649990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.649877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8q6\" (UniqueName: \"kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.649990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.649977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.650183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.650010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.650236 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.650197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.650320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.650305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.674211 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.674183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzzv\" (UniqueName: \"kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.750862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.750766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8q6\" (UniqueName: \"kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.750862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.750847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.751145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.750885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.751277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.751252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.751322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.751282    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.753390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.753368    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"]
Sep 11 16:09:17.757151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.757135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.760491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.760469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:17.772733 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.772713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8q6\" (UniqueName: \"kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.781026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.780991    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"]
Sep 11 16:09:17.852223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.852182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.852399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.852231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.852399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.852308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6jkq\" (UniqueName: \"kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.878419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.878388    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"]
Sep 11 16:09:17.883271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.883254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:17.896576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.896554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:17.900219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.900196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"]
Sep 11 16:09:17.953112 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.953243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.953243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6jkq\" (UniqueName: \"kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.953243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:17.953409 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgvlb\" (UniqueName: \"kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:17.953409 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:17.953820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.953996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.953972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:17.965752 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:17.965717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6jkq\" (UniqueName: \"kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:18.051850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.051825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"]
Sep 11 16:09:18.053737 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:09:18.053712    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b7ee78_0f0d_421e_9cb2_fc653ce7b2de.slice/crio-f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf WatchSource:0}: Error finding container f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf: Status 404 returned error can't find the container with id f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf
Sep 11 16:09:18.053737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.053728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.053940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.053769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgvlb\" (UniqueName: \"kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.053940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.053791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.054113 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.054094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.054181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.054116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.067394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.067367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgvlb\" (UniqueName: \"kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.068001 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.067979    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:18.193178 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.193144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:18.217895 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.217857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"]
Sep 11 16:09:18.219542 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:09:18.219474    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf71602_c9b9_40cc_aa06_65f8476c8376.slice/crio-cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c WatchSource:0}: Error finding container cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c: Status 404 returned error can't find the container with id cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c
Sep 11 16:09:18.321765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.321679    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerID="7e280c0c8c4e8fe27f67509e14c7ccd0f5b130e495964e9723b13009203ed29b" exitCode=0
Sep 11 16:09:18.321930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.321774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv" event={"ID":"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de","Type":"ContainerDied","Data":"7e280c0c8c4e8fe27f67509e14c7ccd0f5b130e495964e9723b13009203ed29b"}
Sep 11 16:09:18.321930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.321834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv" event={"ID":"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de","Type":"ContainerStarted","Data":"f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf"}
Sep 11 16:09:18.323913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.323871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerStarted","Data":"145880d9edac7cbfa0aa92b4a006cc58010a4875542ba4e6da0c6e36478fa7e8"}
Sep 11 16:09:18.324009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.323923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerStarted","Data":"cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c"}
Sep 11 16:09:18.370213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.370190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"]
Sep 11 16:09:18.389407 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:09:18.389377    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77746baa_edad_42af_9efd_37761b28d529.slice/crio-3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377 WatchSource:0}: Error finding container 3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377: Status 404 returned error can't find the container with id 3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377
Sep 11 16:09:18.489203 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:18.489168    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"]
Sep 11 16:09:18.490328 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:09:18.490305    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ee04df_4a01_4b9e_bd89_fcb38a9dee96.slice/crio-ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57 WatchSource:0}: Error finding container ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57: Status 404 returned error can't find the container with id ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57
Sep 11 16:09:19.330636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.330595    2564 generic.go:356] "Generic (PLEG): container finished" podID="77746baa-edad-42af-9efd-37761b28d529" containerID="096fa7e44aae4ed9ac230f080f09aa0769e707321b3e7d588dbeaf73baf70d90" exitCode=0
Sep 11 16:09:19.330820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.330714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w" event={"ID":"77746baa-edad-42af-9efd-37761b28d529","Type":"ContainerDied","Data":"096fa7e44aae4ed9ac230f080f09aa0769e707321b3e7d588dbeaf73baf70d90"}
Sep 11 16:09:19.330820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.330760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w" event={"ID":"77746baa-edad-42af-9efd-37761b28d529","Type":"ContainerStarted","Data":"3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377"}
Sep 11 16:09:19.333119 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.333091    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerID="7d9c3ce3238f9e3543d0bef5e6a9dc3bec3239d11c3b17be2b5328eb80072e59" exitCode=0
Sep 11 16:09:19.333232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.333193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv" event={"ID":"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de","Type":"ContainerDied","Data":"7d9c3ce3238f9e3543d0bef5e6a9dc3bec3239d11c3b17be2b5328eb80072e59"}
Sep 11 16:09:19.335024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.334998    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerID="145880d9edac7cbfa0aa92b4a006cc58010a4875542ba4e6da0c6e36478fa7e8" exitCode=0
Sep 11 16:09:19.335118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.335028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerDied","Data":"145880d9edac7cbfa0aa92b4a006cc58010a4875542ba4e6da0c6e36478fa7e8"}
Sep 11 16:09:19.337045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.337018    2564 generic.go:356] "Generic (PLEG): container finished" podID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerID="13b53a4317c071d0ff8505a67ee90c297ac4ec84cb4f78dcf6ced2cd443651dc" exitCode=0
Sep 11 16:09:19.337168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.337086    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2" event={"ID":"25ee04df-4a01-4b9e-bd89-fcb38a9dee96","Type":"ContainerDied","Data":"13b53a4317c071d0ff8505a67ee90c297ac4ec84cb4f78dcf6ced2cd443651dc"}
Sep 11 16:09:19.337168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:19.337128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2" event={"ID":"25ee04df-4a01-4b9e-bd89-fcb38a9dee96","Type":"ContainerStarted","Data":"ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57"}
Sep 11 16:09:20.344106 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:20.344081    2564 generic.go:356] "Generic (PLEG): container finished" podID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerID="5085ffd8519d47df58f038edccbd1b83a5bf22732ae6886e2e7aa0b084a35851" exitCode=0
Sep 11 16:09:20.344500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:20.344169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2" event={"ID":"25ee04df-4a01-4b9e-bd89-fcb38a9dee96","Type":"ContainerDied","Data":"5085ffd8519d47df58f038edccbd1b83a5bf22732ae6886e2e7aa0b084a35851"}
Sep 11 16:09:20.346712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:20.346684    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerID="fb4a962d688832d065499428778aab40f06c11c69cababafefa1702ec215416e" exitCode=0
Sep 11 16:09:20.346820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:20.346744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv" event={"ID":"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de","Type":"ContainerDied","Data":"fb4a962d688832d065499428778aab40f06c11c69cababafefa1702ec215416e"}
Sep 11 16:09:21.356815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.356782    2564 generic.go:356] "Generic (PLEG): container finished" podID="77746baa-edad-42af-9efd-37761b28d529" containerID="703b14cb81fedebaf8e0a14d246c7b00d70dc28fc57687c0b31ad699882be11e" exitCode=0
Sep 11 16:09:21.357251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.356882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w" event={"ID":"77746baa-edad-42af-9efd-37761b28d529","Type":"ContainerDied","Data":"703b14cb81fedebaf8e0a14d246c7b00d70dc28fc57687c0b31ad699882be11e"}
Sep 11 16:09:21.359045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.359016    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerID="7ff58de69ecdae0a23780988dc70821a8f8de20255606da426f4dc13ce235352" exitCode=0
Sep 11 16:09:21.359126 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.359088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerDied","Data":"7ff58de69ecdae0a23780988dc70821a8f8de20255606da426f4dc13ce235352"}
Sep 11 16:09:21.361381 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.361355    2564 generic.go:356] "Generic (PLEG): container finished" podID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerID="4302e1d047742307d1d6bb5d78e8ca0b5b8e9ad0cc6d01b47d5b20b47b1855d9" exitCode=0
Sep 11 16:09:21.361499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.361435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2" event={"ID":"25ee04df-4a01-4b9e-bd89-fcb38a9dee96","Type":"ContainerDied","Data":"4302e1d047742307d1d6bb5d78e8ca0b5b8e9ad0cc6d01b47d5b20b47b1855d9"}
Sep 11 16:09:21.510741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.510716    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:21.590698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.590658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle\") pod \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") "
Sep 11 16:09:21.590876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.590740    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzzv\" (UniqueName: \"kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv\") pod \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") "
Sep 11 16:09:21.590876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.590846    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util\") pod \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\" (UID: \"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de\") "
Sep 11 16:09:21.591194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.591171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle" (OuterVolumeSpecName: "bundle") pod "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" (UID: "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:21.592942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.592917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv" (OuterVolumeSpecName: "kube-api-access-drzzv") pod "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" (UID: "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de"). InnerVolumeSpecName "kube-api-access-drzzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:09:21.597283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.597245    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util" (OuterVolumeSpecName: "util") pod "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" (UID: "c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:21.691918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.691885    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:21.691918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.691911    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:21.691918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:21.691921    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzzv\" (UniqueName: \"kubernetes.io/projected/c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de-kube-api-access-drzzv\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:22.369271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.369235    2564 generic.go:356] "Generic (PLEG): container finished" podID="77746baa-edad-42af-9efd-37761b28d529" containerID="05f56d7de466c22722353c74d99c1949693199187f08de45efa962650b9929ac" exitCode=0
Sep 11 16:09:22.369668 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.369313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w" event={"ID":"77746baa-edad-42af-9efd-37761b28d529","Type":"ContainerDied","Data":"05f56d7de466c22722353c74d99c1949693199187f08de45efa962650b9929ac"}
Sep 11 16:09:22.371275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.371256    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv"
Sep 11 16:09:22.371417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.371284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z9fkv" event={"ID":"c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de","Type":"ContainerDied","Data":"f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf"}
Sep 11 16:09:22.371417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.371326    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f81ba145e50fec6c5e205f4a902239db7818694bca3f2cf62dc5234d8dc7cdbf"
Sep 11 16:09:22.373764 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.373737    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerID="110f9dc949a65fc3ee6019de391edee3a1ce17c0f4f90239e78073fb6a3d081a" exitCode=0
Sep 11 16:09:22.373880 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.373805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerDied","Data":"110f9dc949a65fc3ee6019de391edee3a1ce17c0f4f90239e78073fb6a3d081a"}
Sep 11 16:09:22.508051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.508023    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:22.600963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.600868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgvlb\" (UniqueName: \"kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb\") pod \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") "
Sep 11 16:09:22.600963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.600916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle\") pod \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") "
Sep 11 16:09:22.601163 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.600981    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util\") pod \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\" (UID: \"25ee04df-4a01-4b9e-bd89-fcb38a9dee96\") "
Sep 11 16:09:22.601564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.601500    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle" (OuterVolumeSpecName: "bundle") pod "25ee04df-4a01-4b9e-bd89-fcb38a9dee96" (UID: "25ee04df-4a01-4b9e-bd89-fcb38a9dee96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:22.603198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.603177    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb" (OuterVolumeSpecName: "kube-api-access-wgvlb") pod "25ee04df-4a01-4b9e-bd89-fcb38a9dee96" (UID: "25ee04df-4a01-4b9e-bd89-fcb38a9dee96"). InnerVolumeSpecName "kube-api-access-wgvlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:09:22.605899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.605853    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util" (OuterVolumeSpecName: "util") pod "25ee04df-4a01-4b9e-bd89-fcb38a9dee96" (UID: "25ee04df-4a01-4b9e-bd89-fcb38a9dee96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:22.701930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.701891    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgvlb\" (UniqueName: \"kubernetes.io/projected/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-kube-api-access-wgvlb\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:22.701930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.701924    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:22.701930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:22.701937    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25ee04df-4a01-4b9e-bd89-fcb38a9dee96-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.381577 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.381549    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2"
Sep 11 16:09:23.381577 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.381562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnfrk2" event={"ID":"25ee04df-4a01-4b9e-bd89-fcb38a9dee96","Type":"ContainerDied","Data":"ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57"}
Sep 11 16:09:23.382073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.381610    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce8ffdec4d63bed50ee33cd01defb28a8ff4d5686b2ed34389eb939c3714ee57"
Sep 11 16:09:23.520505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.520419    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:23.545017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.544992    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:23.611687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util\") pod \"5cf71602-c9b9-40cc-aa06-65f8476c8376\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") "
Sep 11 16:09:23.611893 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6jkq\" (UniqueName: \"kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq\") pod \"77746baa-edad-42af-9efd-37761b28d529\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") "
Sep 11 16:09:23.611893 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611754    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle\") pod \"5cf71602-c9b9-40cc-aa06-65f8476c8376\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") "
Sep 11 16:09:23.611893 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle\") pod \"77746baa-edad-42af-9efd-37761b28d529\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") "
Sep 11 16:09:23.612076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611914    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj8q6\" (UniqueName: \"kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6\") pod \"5cf71602-c9b9-40cc-aa06-65f8476c8376\" (UID: \"5cf71602-c9b9-40cc-aa06-65f8476c8376\") "
Sep 11 16:09:23.612076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.611950    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util\") pod \"77746baa-edad-42af-9efd-37761b28d529\" (UID: \"77746baa-edad-42af-9efd-37761b28d529\") "
Sep 11 16:09:23.612484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.612407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle" (OuterVolumeSpecName: "bundle") pod "77746baa-edad-42af-9efd-37761b28d529" (UID: "77746baa-edad-42af-9efd-37761b28d529"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:23.612638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.612616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle" (OuterVolumeSpecName: "bundle") pod "5cf71602-c9b9-40cc-aa06-65f8476c8376" (UID: "5cf71602-c9b9-40cc-aa06-65f8476c8376"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:23.614207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.614183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6" (OuterVolumeSpecName: "kube-api-access-kj8q6") pod "5cf71602-c9b9-40cc-aa06-65f8476c8376" (UID: "5cf71602-c9b9-40cc-aa06-65f8476c8376"). InnerVolumeSpecName "kube-api-access-kj8q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:09:23.614463 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.614444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq" (OuterVolumeSpecName: "kube-api-access-c6jkq") pod "77746baa-edad-42af-9efd-37761b28d529" (UID: "77746baa-edad-42af-9efd-37761b28d529"). InnerVolumeSpecName "kube-api-access-c6jkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:09:23.617676 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.617652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util" (OuterVolumeSpecName: "util") pod "5cf71602-c9b9-40cc-aa06-65f8476c8376" (UID: "5cf71602-c9b9-40cc-aa06-65f8476c8376"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:23.620462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.620430    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util" (OuterVolumeSpecName: "util") pod "77746baa-edad-42af-9efd-37761b28d529" (UID: "77746baa-edad-42af-9efd-37761b28d529"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713676    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8q6\" (UniqueName: \"kubernetes.io/projected/5cf71602-c9b9-40cc-aa06-65f8476c8376-kube-api-access-kj8q6\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713709    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713719    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-util\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713728    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6jkq\" (UniqueName: \"kubernetes.io/projected/77746baa-edad-42af-9efd-37761b28d529-kube-api-access-c6jkq\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713737    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cf71602-c9b9-40cc-aa06-65f8476c8376-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:23.713779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:23.713747    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77746baa-edad-42af-9efd-37761b28d529-bundle\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:09:24.388618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.388589    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q"
Sep 11 16:09:24.389031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.388617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847at676q" event={"ID":"5cf71602-c9b9-40cc-aa06-65f8476c8376","Type":"ContainerDied","Data":"cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c"}
Sep 11 16:09:24.389031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.388706    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfdc5bfa6dfe8baf48361a37618b8520a0f6dc60f6f4969f3e9aa3442cc5664c"
Sep 11 16:09:24.390833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.390802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w" event={"ID":"77746baa-edad-42af-9efd-37761b28d529","Type":"ContainerDied","Data":"3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377"}
Sep 11 16:09:24.390936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.390852    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c3b1272c9bbc3ddf935b181508a49f63be19c7d762b7a05f50993a2527c3377"
Sep 11 16:09:24.390936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:24.390858    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gsq2w"
Sep 11 16:09:32.386740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:32.386652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:35.236704 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:35.236659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:35.525633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:35.525598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:35.916722 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:35.916624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:36.839533 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:36.839485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:38.568272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:38.568228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:38.740036 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:38.739999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:39.308956 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:39.308918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:39.692305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:39.692193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:39.984276 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:39.984185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:42.294876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:42.294837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:44.315872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:44.315835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:45.510670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:45.510613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:45.762905 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:45.762809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:46.542042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.542007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:46.594366 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594334    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"]
Sep 11 16:09:46.594737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594720    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="util"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594740    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="util"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594755    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="util"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594762    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="util"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594773    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="extract"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594780    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="extract"
Sep 11 16:09:46.594793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594794    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="util"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594801    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="util"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594810    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594817    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594825    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594832    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594845    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594852    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594860    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594867    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594881    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="util"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594888    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="util"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594896    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594903    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="extract"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594914    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594922    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594936    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="pull"
Sep 11 16:09:46.594976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.594943    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="pull"
Sep 11 16:09:46.595473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.595032    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="77746baa-edad-42af-9efd-37761b28d529" containerName="extract"
Sep 11 16:09:46.595473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.595047    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="25ee04df-4a01-4b9e-bd89-fcb38a9dee96" containerName="extract"
Sep 11 16:09:46.595473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.595057    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b7ee78-0f0d-421e-9cb2-fc653ce7b2de" containerName="extract"
Sep 11 16:09:46.595473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.595068    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf71602-c9b9-40cc-aa06-65f8476c8376" containerName="extract"
Sep 11 16:09:46.599401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.599384    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.603859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.603836    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 16:09:46.603979 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.603949    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 16:09:46.604415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.604401    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b99gd\""
Sep 11 16:09:46.604486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.604469    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 16:09:46.604703 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.604686    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 16:09:46.616237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.616213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"]
Sep 11 16:09:46.721255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.721224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7a5371-d739-4292-84e3-4184255a484d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.721434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.721294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7a5371-d739-4292-84e3-4184255a484d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.721434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.721338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lxxn\" (UniqueName: \"kubernetes.io/projected/bd7a5371-d739-4292-84e3-4184255a484d-kube-api-access-4lxxn\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.822637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.822546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7a5371-d739-4292-84e3-4184255a484d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.822637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.822621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7a5371-d739-4292-84e3-4184255a484d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.822873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.822662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lxxn\" (UniqueName: \"kubernetes.io/projected/bd7a5371-d739-4292-84e3-4184255a484d-kube-api-access-4lxxn\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.823229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.823203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd7a5371-d739-4292-84e3-4184255a484d-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.825189 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.825169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7a5371-d739-4292-84e3-4184255a484d-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.835480 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.835460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lxxn\" (UniqueName: \"kubernetes.io/projected/bd7a5371-d739-4292-84e3-4184255a484d-kube-api-access-4lxxn\") pod \"kuadrant-console-plugin-fbdd4f445-hrbvk\" (UID: \"bd7a5371-d739-4292-84e3-4184255a484d\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:46.873124 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.873074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:46.909884 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:46.909846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"
Sep 11 16:09:47.212831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:47.212796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk"]
Sep 11 16:09:47.214350 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:09:47.214310    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd7a5371_d739_4292_84e3_4184255a484d.slice/crio-185a943579532c5ce86f2e48cbe6177dc6b965111573849b268f383f153be8b3 WatchSource:0}: Error finding container 185a943579532c5ce86f2e48cbe6177dc6b965111573849b268f383f153be8b3: Status 404 returned error can't find the container with id 185a943579532c5ce86f2e48cbe6177dc6b965111573849b268f383f153be8b3
Sep 11 16:09:47.511559 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:47.511513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk" event={"ID":"bd7a5371-d739-4292-84e3-4184255a484d","Type":"ContainerStarted","Data":"185a943579532c5ce86f2e48cbe6177dc6b965111573849b268f383f153be8b3"}
Sep 11 16:09:50.263377 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:50.263337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:50.410212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:50.410173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:51.223666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:51.223631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:51.337209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:51.337170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:51.952502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:51.952408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:52.049604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:52.049571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:09:52.541830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:52.541795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk" event={"ID":"bd7a5371-d739-4292-84e3-4184255a484d","Type":"ContainerStarted","Data":"f422c112d98320760e00f0798176adf8296ead9901d84b9ac7ec592301c890e7"}
Sep 11 16:09:52.567183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:09:52.567128    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-hrbvk" podStartSLOduration=2.257357931 podStartE2EDuration="6.567111457s" totalImagesPullingTime="4.309753526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:09:52.563892615 +0000 UTC m=+462.826138758" watchObservedRunningTime="2026-09-11 16:09:52.567111457 +0000 UTC m=+462.829357646"
Sep 11 16:10:00.324589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:00.324547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:00.422551 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:00.422491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:03.358308 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:03.358263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:03.469550 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:03.469481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:05.952569 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:05.952505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:06.051147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:06.051119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:10.677040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:10.676974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:10.785467 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:10.785426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:10.886843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:10.886807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:19.610367 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:19.610301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:19.710999 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:19.710960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:22.533453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:22.533423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:22.672440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:22.672407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:25.124848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:25.124813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:25.246049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:25.246011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:25.482192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:25.482100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:25.578457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:25.578404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:27.053222 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:27.053182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:27.245490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:27.245457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:29.314215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.314176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:29.481692 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.481657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:29.584430 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.584347    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:10:29.605377 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.605351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.608775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.608748    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 16:10:29.614581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.614559    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:10:29.665839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.665804    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:10:29.709606 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.709570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqr2\" (UniqueName: \"kubernetes.io/projected/8048b2c4-20f1-4df1-8de4-6a8e31078193-kube-api-access-2pqr2\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.709781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.709620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8048b2c4-20f1-4df1-8de4-6a8e31078193-config-file\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.810365 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.810335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqr2\" (UniqueName: \"kubernetes.io/projected/8048b2c4-20f1-4df1-8de4-6a8e31078193-kube-api-access-2pqr2\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.810597 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.810393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8048b2c4-20f1-4df1-8de4-6a8e31078193-config-file\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.811066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.811040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8048b2c4-20f1-4df1-8de4-6a8e31078193-config-file\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.831912 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.831883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqr2\" (UniqueName: \"kubernetes.io/projected/8048b2c4-20f1-4df1-8de4-6a8e31078193-kube-api-access-2pqr2\") pod \"limitador-limitador-84994f7ffc-q2dbj\" (UID: \"8048b2c4-20f1-4df1-8de4-6a8e31078193\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:29.915723 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:29.915640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:30.201683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.201660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:10:30.204033 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:10:30.204004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8048b2c4_20f1_4df1_8de4_6a8e31078193.slice/crio-96da02f615d8f90c7200eee342815f111c251f2c7775bf4ad3e80ecfe502ea63 WatchSource:0}: Error finding container 96da02f615d8f90c7200eee342815f111c251f2c7775bf4ad3e80ecfe502ea63: Status 404 returned error can't find the container with id 96da02f615d8f90c7200eee342815f111c251f2c7775bf4ad3e80ecfe502ea63
Sep 11 16:10:30.380851 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.380809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:30.508726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.508691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:30.618395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.618358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:30.747507 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.747477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj" event={"ID":"8048b2c4-20f1-4df1-8de4-6a8e31078193","Type":"ContainerStarted","Data":"96da02f615d8f90c7200eee342815f111c251f2c7775bf4ad3e80ecfe502ea63"}
Sep 11 16:10:30.995193 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:30.995107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:31.092898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:31.092861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:31.315341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:31.315305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:31.470963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:31.470926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:32.760179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:32.760146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj" event={"ID":"8048b2c4-20f1-4df1-8de4-6a8e31078193","Type":"ContainerStarted","Data":"3c01f1dc1525743c355cd774d4a640f38463d507061cab37786f2fe2a02883fb"}
Sep 11 16:10:32.760620 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:32.760213    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:32.781214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:32.781154    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj" podStartSLOduration=1.611312691 podStartE2EDuration="3.781135696s" totalImagesPullingTime="2.169823005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:10:32.778601432 +0000 UTC m=+503.040847575" watchObservedRunningTime="2026-09-11 16:10:32.781135696 +0000 UTC m=+503.043381838"
Sep 11 16:10:39.343218 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:39.343180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:39.443995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:39.443954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:42.779727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:42.779684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:42.880583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:42.880542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:43.766312 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:43.766284    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"
Sep 11 16:10:45.234078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:45.234036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:45.364365 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:45.364326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:45.764727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:45.764689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:58.126457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:58.126417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:10:58.414963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:10:58.414866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:05.972977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:05.972891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:06.101368 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:06.101330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:06.268282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:06.268245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:06.361694 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:06.361659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:09.814434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:09.814402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:09.897919 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:09.897888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:17.033350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:17.033310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:40.801271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:40.801227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:40.899482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:40.899445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:42.320194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:42.320151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:42.417470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:42.417431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:42.730188 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:42.730103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:42.869537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:42.869484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:42.969371 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:42.969327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:43.198198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:43.198158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:11:43.242130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:43.242101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:54.162503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:54.162465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:11:54.250158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:11:54.250123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:12:10.210972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:10.210942    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:12:10.212244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:10.212218    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:12:14.209110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:14.209062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:12:32.574339 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.574262    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"]
Sep 11 16:12:32.577629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.577608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.582443 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.582421    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 16:12:32.582607 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.582469    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 16:12:32.582607 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.582421    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 16:12:32.582607 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.582429    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zrm4z\""
Sep 11 16:12:32.592665 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.592640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"]
Sep 11 16:12:32.627435 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.627408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:12:32.697322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztr2f\" (UniqueName: \"kubernetes.io/projected/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-kube-api-access-ztr2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.697322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.697631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.697631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.697631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.697631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.697585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798011 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.797971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztr2f\" (UniqueName: \"kubernetes.io/projected/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-kube-api-access-ztr2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.798631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.798594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.800446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.800424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.800756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.800741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.807369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.807339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztr2f\" (UniqueName: \"kubernetes.io/projected/d5cd621a-bc8e-4deb-9a32-d5cfa4599224-kube-api-access-ztr2f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs\" (UID: \"d5cd621a-bc8e-4deb-9a32-d5cfa4599224\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:32.887851 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:32.887761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:33.163279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:33.163255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"]
Sep 11 16:12:33.165818 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:12:33.165776    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5cd621a_bc8e_4deb_9a32_d5cfa4599224.slice/crio-3427ca585397244fa382d2ff8f9e1b4430c4dcd48941bd4b9511db499d54ff4c WatchSource:0}: Error finding container 3427ca585397244fa382d2ff8f9e1b4430c4dcd48941bd4b9511db499d54ff4c: Status 404 returned error can't find the container with id 3427ca585397244fa382d2ff8f9e1b4430c4dcd48941bd4b9511db499d54ff4c
Sep 11 16:12:33.166993 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:33.166976    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:12:33.167663 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:33.167643    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:12:33.404134 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:33.404088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs" event={"ID":"d5cd621a-bc8e-4deb-9a32-d5cfa4599224","Type":"ContainerStarted","Data":"3427ca585397244fa382d2ff8f9e1b4430c4dcd48941bd4b9511db499d54ff4c"}
Sep 11 16:12:34.412234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:34.412200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs" event={"ID":"d5cd621a-bc8e-4deb-9a32-d5cfa4599224","Type":"ContainerStarted","Data":"b4a07c58f95d876e7026475afb20cae1dd84fd99fa5c1d5528b1772f01a40f47"}
Sep 11 16:12:34.438659 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:34.438605    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs" podStartSLOduration=1.279816836 podStartE2EDuration="2.438586636s" totalImagesPullingTime="1.1587698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:12:34.43715678 +0000 UTC m=+624.699402922" watchObservedRunningTime="2026-09-11 16:12:34.438586636 +0000 UTC m=+624.700832790"
Sep 11 16:12:42.413281 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:42.413240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:12:42.888895 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:42.888854    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:42.889111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:42.888944    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:42.902044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:42.902017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:43.272694 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:43.272660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:12:43.476480 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:43.476449    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs"
Sep 11 16:12:58.544313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:12:58.544278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:04.374079 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:04.374032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:05.558934 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:05.558900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:13:24.543998 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:24.543957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:25.910746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:25.910712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:13:29.521273 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:29.521238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:30.884420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:30.884380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:13:37.807238 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:37.807190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:39.878909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:39.878872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:13:41.286405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:41.286358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:41.352729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:41.352692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:58.679839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.679802    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"]
Sep 11 16:13:58.682135 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.682117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.684962 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.684944    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 16:13:58.696039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.696013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"]
Sep 11 16:13:58.786317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.786317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.786536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52v7\" (UniqueName: \"kubernetes.io/projected/dac8b624-9de1-4501-a46d-f9a89d0d4d53-kube-api-access-f52v7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.786536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.786536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.786536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.786501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.793024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.792997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:13:58.887821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.887786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.887821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.887822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.887845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52v7\" (UniqueName: \"kubernetes.io/projected/dac8b624-9de1-4501-a46d-f9a89d0d4d53-kube-api-access-f52v7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.887965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.888024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888201 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.888058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.888236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.888311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.888387 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.888324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.890430 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.890407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac8b624-9de1-4501-a46d-f9a89d0d4d53-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.890703 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.890682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac8b624-9de1-4501-a46d-f9a89d0d4d53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.896458 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.896434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52v7\" (UniqueName: \"kubernetes.io/projected/dac8b624-9de1-4501-a46d-f9a89d0d4d53-kube-api-access-f52v7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq\" (UID: \"dac8b624-9de1-4501-a46d-f9a89d0d4d53\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:58.991423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:58.991332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:13:59.267195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:59.267174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"]
Sep 11 16:13:59.269254 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:13:59.269229    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac8b624_9de1_4501_a46d_f9a89d0d4d53.slice/crio-82264b269bb853008c8d0b865d1a0bb1098524b575254352597245391df0db99 WatchSource:0}: Error finding container 82264b269bb853008c8d0b865d1a0bb1098524b575254352597245391df0db99: Status 404 returned error can't find the container with id 82264b269bb853008c8d0b865d1a0bb1098524b575254352597245391df0db99
Sep 11 16:13:59.881140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:59.881108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq" event={"ID":"dac8b624-9de1-4501-a46d-f9a89d0d4d53","Type":"ContainerStarted","Data":"4b059000574ef3254097843535d5d0a08f94fc8c4fb8949176c84ffaeb50f72b"}
Sep 11 16:13:59.881140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:59.881146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq" event={"ID":"dac8b624-9de1-4501-a46d-f9a89d0d4d53","Type":"ContainerStarted","Data":"82264b269bb853008c8d0b865d1a0bb1098524b575254352597245391df0db99"}
Sep 11 16:13:59.902004 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:13:59.901954    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq" podStartSLOduration=1.737222399 podStartE2EDuration="1.901938563s" totalImagesPullingTime="164.716164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:13:59.8987593 +0000 UTC m=+710.161005441" watchObservedRunningTime="2026-09-11 16:13:59.901938563 +0000 UTC m=+710.164184705"
Sep 11 16:14:00.969147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:14:00.969065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:14:08.991940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:14:08.991894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:14:08.992433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:14:08.991964    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:14:09.004632 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:14:09.004604    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:14:09.951386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:14:09.951348    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq"
Sep 11 16:15:00.151425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.151386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"]
Sep 11 16:15:00.154786 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.154769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"
Sep 11 16:15:00.157619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.157596    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:15:00.163679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.163653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"]
Sep 11 16:15:00.165870 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.165850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"
Sep 11 16:15:00.449209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:00.449186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"]
Sep 11 16:15:00.451090 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:15:00.451058    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa6fd0f_bbdd_4689_af46_57b950d758d5.slice/crio-75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5 WatchSource:0}: Error finding container 75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5: Status 404 returned error can't find the container with id 75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5
Sep 11 16:15:01.218481 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:01.218445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t" event={"ID":"6fa6fd0f-bbdd-4689-af46-57b950d758d5","Type":"ContainerStarted","Data":"75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5"}
Sep 11 16:15:03.233044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:03.232946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t" event={"ID":"6fa6fd0f-bbdd-4689-af46-57b950d758d5","Type":"ContainerStarted","Data":"535d9983c917badfec207db74e885b33d0dbcf1c2c36c7b572e66e69fbc64c7c"}
Sep 11 16:15:03.253261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:03.253201    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t" podStartSLOduration=0.780318542 podStartE2EDuration="3.253182307s" totalImagesPullingTime="2.472863765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:03.252682829 +0000 UTC m=+773.514928971" watchObservedRunningTime="2026-09-11 16:15:03.253182307 +0000 UTC m=+773.515428448"
Sep 11 16:15:04.240970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:04.240879    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fa6fd0f-bbdd-4689-af46-57b950d758d5" containerID="535d9983c917badfec207db74e885b33d0dbcf1c2c36c7b572e66e69fbc64c7c" exitCode=0
Sep 11 16:15:04.241352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:04.240971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t" event={"ID":"6fa6fd0f-bbdd-4689-af46-57b950d758d5","Type":"ContainerDied","Data":"535d9983c917badfec207db74e885b33d0dbcf1c2c36c7b572e66e69fbc64c7c"}
Sep 11 16:15:05.387732 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:05.387699    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"
Sep 11 16:15:06.253333 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:06.253301    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t"
Sep 11 16:15:06.253506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:06.253342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819055-s856t" event={"ID":"6fa6fd0f-bbdd-4689-af46-57b950d758d5","Type":"ContainerDied","Data":"75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5"}
Sep 11 16:15:06.253506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:06.253428    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75c8b2c3145a626fa6451470796b8aa628aeb3f340e9562b1cac81d506812ab5"
Sep 11 16:15:16.680432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:16.680394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:16.814318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:16.814266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:17.775219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:17.775173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:17.865639 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:17.865598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:32.891213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:32.891123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:33.012578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:33.012542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:33.221412 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:33.221317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:33.354325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:33.354296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:34.212957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.212925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:34.376632 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.376597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:34.703099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.703067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:34.848091 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.848058    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7601-d8e906"]
Sep 11 16:15:34.848445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.848432    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa6fd0f-bbdd-4689-af46-57b950d758d5" containerName="cleanup"
Sep 11 16:15:34.848491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.848448    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa6fd0f-bbdd-4689-af46-57b950d758d5" containerName="cleanup"
Sep 11 16:15:34.848554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.848531    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa6fd0f-bbdd-4689-af46-57b950d758d5" containerName="cleanup"
Sep 11 16:15:34.851423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.851404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:34.854410 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.854390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6jw6\" (UniqueName: \"kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6\") pod \"test-curl-7601-d8e906\" (UID: \"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2\") " pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:34.855290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.855271    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xwld7\""
Sep 11 16:15:34.886195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.886164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7601-d8e906"]
Sep 11 16:15:34.955667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.955574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6jw6\" (UniqueName: \"kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6\") pod \"test-curl-7601-d8e906\" (UID: \"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2\") " pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:34.972497 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:34.972465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6jw6\" (UniqueName: \"kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6\") pod \"test-curl-7601-d8e906\" (UID: \"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2\") " pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:35.160303 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:35.160251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:35.438394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:35.438372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7601-d8e906"]
Sep 11 16:15:35.440247 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:15:35.440221    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd66087f_a60d_48f3_bbc4_ebacc3da5dd2.slice/crio-4f64bd121ba40c0c367ecc92bebbe872917ca81d62fc9ecfdfa36d7345cf569b WatchSource:0}: Error finding container 4f64bd121ba40c0c367ecc92bebbe872917ca81d62fc9ecfdfa36d7345cf569b: Status 404 returned error can't find the container with id 4f64bd121ba40c0c367ecc92bebbe872917ca81d62fc9ecfdfa36d7345cf569b
Sep 11 16:15:36.429969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:36.429937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7601-d8e906" event={"ID":"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2","Type":"ContainerStarted","Data":"4f64bd121ba40c0c367ecc92bebbe872917ca81d62fc9ecfdfa36d7345cf569b"}
Sep 11 16:15:36.550213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:36.550169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:15:36.587063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:36.587026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:36.831288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:36.831248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:38.020509 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.020476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:38.120374 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.120342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:38.381704 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.381607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:38.442150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.442117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7601-d8e906" event={"ID":"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2","Type":"ContainerStarted","Data":"a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f"}
Sep 11 16:15:38.466862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.466808    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7601-d8e906" podStartSLOduration=2.467008175 podStartE2EDuration="4.466789095s" totalImagesPullingTime="1.99978092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:38.465246848 +0000 UTC m=+808.727492990" watchObservedRunningTime="2026-09-11 16:15:38.466789095 +0000 UTC m=+808.729035236"
Sep 11 16:15:38.658570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.658426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:38.756320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:38.756282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:39.084131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.084089    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7601-d8e906"]
Sep 11 16:15:39.090335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.090304    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7601-d8e906"]
Sep 11 16:15:39.217408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.217366    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7601-9f5dbb"]
Sep 11 16:15:39.217857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.217836    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" containerName="test-curl-7601-d8e906"
Sep 11 16:15:39.217978 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.217859    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" containerName="test-curl-7601-d8e906"
Sep 11 16:15:39.217978 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.217960    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" containerName="test-curl-7601-d8e906"
Sep 11 16:15:39.220983 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.220961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:39.228538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.228489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7601-9f5dbb"]
Sep 11 16:15:39.294889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.294858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqjz\" (UniqueName: \"kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz\") pod \"test-curl-7601-9f5dbb\" (UID: \"892c9397-485d-46e4-8cbd-1780bbe2020d\") " pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:39.395924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.395840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqjz\" (UniqueName: \"kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz\") pod \"test-curl-7601-9f5dbb\" (UID: \"892c9397-485d-46e4-8cbd-1780bbe2020d\") " pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:39.410099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.410065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqjz\" (UniqueName: \"kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz\") pod \"test-curl-7601-9f5dbb\" (UID: \"892c9397-485d-46e4-8cbd-1780bbe2020d\") " pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:39.448594 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:39.448560    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7601-d8e906" container="test-curl-7601-d8e906"
Sep 11 16:15:39.532693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.532663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:39.804500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:39.804474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7601-9f5dbb"]
Sep 11 16:15:39.806302 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:15:39.806277    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod892c9397_485d_46e4_8cbd_1780bbe2020d.slice/crio-eb367efda3da9e22abc2499e902d1563c5a0b8098303af7d41479744ca93b3bc WatchSource:0}: Error finding container eb367efda3da9e22abc2499e902d1563c5a0b8098303af7d41479744ca93b3bc: Status 404 returned error can't find the container with id eb367efda3da9e22abc2499e902d1563c5a0b8098303af7d41479744ca93b3bc
Sep 11 16:15:40.455290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:40.455246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7601-9f5dbb" event={"ID":"892c9397-485d-46e4-8cbd-1780bbe2020d","Type":"ContainerStarted","Data":"d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba"}
Sep 11 16:15:40.455785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:40.455298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7601-9f5dbb" event={"ID":"892c9397-485d-46e4-8cbd-1780bbe2020d","Type":"ContainerStarted","Data":"eb367efda3da9e22abc2499e902d1563c5a0b8098303af7d41479744ca93b3bc"}
Sep 11 16:15:40.455785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:40.455341    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7601-d8e906" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" containerName="test-curl-7601-d8e906" containerID="cri-o://a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f" gracePeriod=2
Sep 11 16:15:40.474169 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:40.474115    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7601-9f5dbb" podStartSLOduration=1.474097725 podStartE2EDuration="1.474097725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:40.471621092 +0000 UTC m=+810.733867234" watchObservedRunningTime="2026-09-11 16:15:40.474097725 +0000 UTC m=+810.736343867"
Sep 11 16:15:41.009120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.009085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.040475 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.040429    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7601-9f5dbb"]
Sep 11 16:15:41.043209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.043176    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7601-9f5dbb"]
Sep 11 16:15:41.073123 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.073079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.224157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.224053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.460770 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:41.460741    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7601-9f5dbb" container="test-curl-7601-9f5dbb"
Sep 11 16:15:41.527667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.527620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.626938 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.626896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.748318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.748286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.827590 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.827490    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:15:41.828061 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.828032    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" containerName="test-curl-7601-9f5dbb"
Sep 11 16:15:41.828061 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.828056    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" containerName="test-curl-7601-9f5dbb"
Sep 11 16:15:41.828219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.828176    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" containerName="test-curl-7601-9f5dbb"
Sep 11 16:15:41.831412 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.831393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.833880 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.833851    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:15:41.833880 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.833880    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-e12be0-openshift-default-dockercfg-484k4\""
Sep 11 16:15:41.844608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.844579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:15:41.859047 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.859000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:41.921300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgz7k\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:41.921729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:41.921654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgz7k\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.022900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.023261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.022946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.023261 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.023104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.023371 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.023298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.023629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.023365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.023629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.023410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.025137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.025115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.025401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.025384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.032933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.032904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.033233 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.033209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgz7k\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k\") pod \"e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") " pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.143899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.143809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:42.170040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.170002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:42.422804 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.422777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:15:42.424182 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:15:42.424146    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2715aa63_4d4d_424d_8b42_272c3d25c516.slice/crio-bf03627609c0bb2931aa9d8ab2cd145906cf712c1b0f70089773c6ba6b91454b WatchSource:0}: Error finding container bf03627609c0bb2931aa9d8ab2cd145906cf712c1b0f70089773c6ba6b91454b: Status 404 returned error can't find the container with id bf03627609c0bb2931aa9d8ab2cd145906cf712c1b0f70089773c6ba6b91454b
Sep 11 16:15:42.468124 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.468089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerStarted","Data":"bf03627609c0bb2931aa9d8ab2cd145906cf712c1b0f70089773c6ba6b91454b"}
Sep 11 16:15:42.468416 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.468243    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7601-9f5dbb" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" containerName="test-curl-7601-9f5dbb" containerID="cri-o://d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba" gracePeriod=2
Sep 11 16:15:42.614291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.614262    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:42.729690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.729597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6jw6\" (UniqueName: \"kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6\") pod \"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2\" (UID: \"bd66087f-a60d-48f3-bbc4-ebacc3da5dd2\") "
Sep 11 16:15:42.732010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.731986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6" (OuterVolumeSpecName: "kube-api-access-p6jw6") pod "bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" (UID: "bd66087f-a60d-48f3-bbc4-ebacc3da5dd2"). InnerVolumeSpecName "kube-api-access-p6jw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:15:42.830393 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:42.830354    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6jw6\" (UniqueName: \"kubernetes.io/projected/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2-kube-api-access-p6jw6\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:15:43.315171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.315074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:43.477099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.477067    2564 generic.go:356] "Generic (PLEG): container finished" podID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" containerID="a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f" exitCode=137
Sep 11 16:15:43.477579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.477133    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:43.477579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.477182    2564 scope.go:117] "RemoveContainer" containerID="a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f"
Sep 11 16:15:43.489455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.489429    2564 scope.go:117] "RemoveContainer" containerID="a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f"
Sep 11 16:15:43.489854 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:43.489825    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f\": container with ID starting with a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f not found: ID does not exist" containerID="a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f"
Sep 11 16:15:43.489963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:43.489865    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f"} err="failed to get container status \"a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f\": rpc error: code = NotFound desc = could not find container \"a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f\": container with ID starting with a9ef77fa76f3553f2678ffaefc143c212c95410c663b47db4fc2b57b9b96e61f not found: ID does not exist"
Sep 11 16:15:43.490612 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:43.490589    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7601-d8e906\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" pod="opendatahub/test-curl-7601-d8e906"
Sep 11 16:15:44.076585 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:44.076468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:44.171980 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:44.171925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:44.287898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:44.287862    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd66087f-a60d-48f3-bbc4-ebacc3da5dd2" path="/var/lib/kubelet/pods/bd66087f-a60d-48f3-bbc4-ebacc3da5dd2/volumes"
Sep 11 16:15:44.293162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:44.293128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:45.084570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.084531    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:15:45.084900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.084615    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:15:45.084900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.084644    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:15:45.167709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.167679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:45.255936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.255906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxqjz\" (UniqueName: \"kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz\") pod \"892c9397-485d-46e4-8cbd-1780bbe2020d\" (UID: \"892c9397-485d-46e4-8cbd-1780bbe2020d\") "
Sep 11 16:15:45.258433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.258397    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz" (OuterVolumeSpecName: "kube-api-access-gxqjz") pod "892c9397-485d-46e4-8cbd-1780bbe2020d" (UID: "892c9397-485d-46e4-8cbd-1780bbe2020d"). InnerVolumeSpecName "kube-api-access-gxqjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:15:45.356745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.356653    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxqjz\" (UniqueName: \"kubernetes.io/projected/892c9397-485d-46e4-8cbd-1780bbe2020d-kube-api-access-gxqjz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:15:45.493019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.492978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerStarted","Data":"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"}
Sep 11 16:15:45.494725 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.494659    2564 generic.go:356] "Generic (PLEG): container finished" podID="892c9397-485d-46e4-8cbd-1780bbe2020d" containerID="d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba" exitCode=137
Sep 11 16:15:45.494725 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.494715    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:45.494878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.494766    2564 scope.go:117] "RemoveContainer" containerID="d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba"
Sep 11 16:15:45.507000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.506829    2564 scope.go:117] "RemoveContainer" containerID="d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba"
Sep 11 16:15:45.507276 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:45.507245    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba\": container with ID starting with d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba not found: ID does not exist" containerID="d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba"
Sep 11 16:15:45.507385 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.507288    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba"} err="failed to get container status \"d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba\": rpc error: code = NotFound desc = could not find container \"d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba\": container with ID starting with d7ca499c64d9a82b0e2fbe1d6ce7e89bfba43fc5ce2b6390a29cf290cbaa0eba not found: ID does not exist"
Sep 11 16:15:45.536806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.536743    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podStartSLOduration=1.878888672 podStartE2EDuration="4.536720343s" totalImagesPullingTime="2.657831671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:45.534605872 +0000 UTC m=+815.796852036" watchObservedRunningTime="2026-09-11 16:15:45.536720343 +0000 UTC m=+815.798966486"
Sep 11 16:15:45.537310 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:45.537280    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7601-9f5dbb\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:45.578259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.578208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:45.663568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.663451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:45.856586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:45.856547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:46.144000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.143963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:46.149246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.149222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:46.151925 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:15:46.151895    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7601-9f5dbb\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" pod="opendatahub/test-curl-7601-9f5dbb"
Sep 11 16:15:46.287408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.287372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="892c9397-485d-46e4-8cbd-1780bbe2020d" path="/var/lib/kubelet/pods/892c9397-485d-46e4-8cbd-1780bbe2020d/volumes"
Sep 11 16:15:46.293384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.293352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:46.392403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.392369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:46.502667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.502583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:46.503768 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.503741    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:15:46.981002 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:46.980964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:47.509690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.509660    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:15:47.514662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.514644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.517200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.517181    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-1e9d2637-kserve-self-signed-certs\""
Sep 11 16:15:47.544793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.544764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:15:47.578781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.578747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.578952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.578843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.578952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.578876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.579107 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.578975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.579107 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.578996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.579107 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.579101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjv5m\" (UniqueName: \"kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjv5m\" (UniqueName: \"kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680246 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.680769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.680757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.683184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.683161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.683462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.683442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.696323 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.696298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjv5m\" (UniqueName: \"kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m\") pod \"e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") " pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.711824 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.711785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:47.823776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.823680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:47.897254 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:47.897218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:48.104275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:48.104249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:15:48.105666 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:15:48.105646    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8373125_3a64_4970_a730_14778c642e7c.slice/crio-13d0b4937a42dd8f67bad7d2f726586fbe7b6e581bb0ac949aaa4f232a21da2f WatchSource:0}: Error finding container 13d0b4937a42dd8f67bad7d2f726586fbe7b6e581bb0ac949aaa4f232a21da2f: Status 404 returned error can't find the container with id 13d0b4937a42dd8f67bad7d2f726586fbe7b6e581bb0ac949aaa4f232a21da2f
Sep 11 16:15:48.516239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:48.516200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" event={"ID":"f8373125-3a64-4970-a730-14778c642e7c","Type":"ContainerStarted","Data":"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"}
Sep 11 16:15:48.516671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:48.516251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" event={"ID":"f8373125-3a64-4970-a730-14778c642e7c","Type":"ContainerStarted","Data":"13d0b4937a42dd8f67bad7d2f726586fbe7b6e581bb0ac949aaa4f232a21da2f"}
Sep 11 16:15:48.589184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:48.589120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" podStartSLOduration=1.5891001120000001 podStartE2EDuration="1.589100112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:48.585578148 +0000 UTC m=+818.847824283" watchObservedRunningTime="2026-09-11 16:15:48.589100112 +0000 UTC m=+818.851346254"
Sep 11 16:15:48.752593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:48.752553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:50.036321 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:50.036284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:50.493268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:50.493178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:15:50.981000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:50.980960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.202630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.202588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.335887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.335855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.465836 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.465797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.577782 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.577747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.763687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.763648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.873170 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.873130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:51.970796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:51.970757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:52.065583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:52.065454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:52.487441 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:52.487328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:52.692383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:52.692342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:52.831180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:52.831136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:53.027033 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:53.026997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:54.411672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:54.411633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:54.939680 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:54.939627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:55.099734 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:55.099702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:55.570250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:55.570205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:56.359946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:56.359909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:57.458570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:57.458533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:57.824470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:57.824436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:57.824688 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:57.824494    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:57.844268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:57.844228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:58.212899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:58.212791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:58.584252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:58.584221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:15:59.407551 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.407501    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"]
Sep 11 16:15:59.411776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.411754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:15:59.414764 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.414745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:15:59.414887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.414835    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:15:59.422965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.421989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"]
Sep 11 16:15:59.429871 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.429846    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:15:59.433882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.433863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.437360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.437273    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b6b139-serving-cert\""
Sep 11 16:15:59.437498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.437438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:15:59.437498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.437460    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p2kww\""
Sep 11 16:15:59.437744 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.437695    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:15:59.449360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.449330    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:15:59.473605 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.473570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:59.496445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.496411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16046061-vdzrl\" (UID: \"d32c637b-f0f0-4f3d-ae91-8e6f42936866\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:15:59.540382 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.540355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:59.597014 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.596980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16046061-vdzrl\" (UID: \"d32c637b-f0f0-4f3d-ae91-8e6f42936866\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:15:59.597470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.597036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.597470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.597066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.597470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.597114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.597470 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.597157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckhf\" (UniqueName: \"kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.597892 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.597865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16046061-vdzrl\" (UID: \"d32c637b-f0f0-4f3d-ae91-8e6f42936866\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:15:59.697740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.697626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.697740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.697676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.697740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.697704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.698026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.697758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckhf\" (UniqueName: \"kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.698368 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.698300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:15:59.698555 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.698503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.700946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.700927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.701085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.701066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.708595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.708568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckhf\" (UniqueName: \"kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf\") pod \"maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:15:59.727274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.727230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:15:59.747267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:15:59.747236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:16:00.010622 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.010594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"]
Sep 11 16:16:00.012550 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:16:00.012496    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32c637b_f0f0_4f3d_ae91_8e6f42936866.slice/crio-b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89 WatchSource:0}: Error finding container b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89: Status 404 returned error can't find the container with id b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89
Sep 11 16:16:00.059286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.059258    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:16:00.061446 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:16:00.061414    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38e801c_0ba1_4fcc_90c7_9d6aaf220dd3.slice/crio-97cec84a9aec8bf90455995fb2ebe44ab2e7268067a532c70cf7a523328a8e8d WatchSource:0}: Error finding container 97cec84a9aec8bf90455995fb2ebe44ab2e7268067a532c70cf7a523328a8e8d: Status 404 returned error can't find the container with id 97cec84a9aec8bf90455995fb2ebe44ab2e7268067a532c70cf7a523328a8e8d
Sep 11 16:16:00.129490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.129458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:00.231833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.231797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:00.590450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.590357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" event={"ID":"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3","Type":"ContainerStarted","Data":"97cec84a9aec8bf90455995fb2ebe44ab2e7268067a532c70cf7a523328a8e8d"}
Sep 11 16:16:00.592451 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.592421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl" event={"ID":"d32c637b-f0f0-4f3d-ae91-8e6f42936866","Type":"ContainerStarted","Data":"4e9a3c2af21aa095b16b8ff0dce7bfc3d5fe8fc8b402fbb343d1aea7dd333997"}
Sep 11 16:16:00.592609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.592473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl" event={"ID":"d32c637b-f0f0-4f3d-ae91-8e6f42936866","Type":"ContainerStarted","Data":"b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89"}
Sep 11 16:16:00.610896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.610838    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl" podStartSLOduration=1.610815746 podStartE2EDuration="1.610815746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:00.608497363 +0000 UTC m=+830.870743516" watchObservedRunningTime="2026-09-11 16:16:00.610815746 +0000 UTC m=+830.873061892"
Sep 11 16:16:00.687482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:00.687441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:01.608237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:01.608201    2564 generic.go:356] "Generic (PLEG): container finished" podID="d32c637b-f0f0-4f3d-ae91-8e6f42936866" containerID="4e9a3c2af21aa095b16b8ff0dce7bfc3d5fe8fc8b402fbb343d1aea7dd333997" exitCode=0
Sep 11 16:16:01.608436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:01.608241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl" event={"ID":"d32c637b-f0f0-4f3d-ae91-8e6f42936866","Type":"ContainerDied","Data":"4e9a3c2af21aa095b16b8ff0dce7bfc3d5fe8fc8b402fbb343d1aea7dd333997"}
Sep 11 16:16:01.899600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:01.895193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:02.749084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:02.749047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:02.801576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:02.784263    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:16:02.932661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:02.932577    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca\") pod \"d32c637b-f0f0-4f3d-ae91-8e6f42936866\" (UID: \"d32c637b-f0f0-4f3d-ae91-8e6f42936866\") "
Sep 11 16:16:02.933065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:02.932967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d32c637b-f0f0-4f3d-ae91-8e6f42936866" (UID: "d32c637b-f0f0-4f3d-ae91-8e6f42936866"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:16:03.034233 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.034190    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32c637b-f0f0-4f3d-ae91-8e6f42936866-maas-api-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:16:03.491815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.491772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:03.621300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.621270    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"
Sep 11 16:16:03.621459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.621308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl" event={"ID":"d32c637b-f0f0-4f3d-ae91-8e6f42936866","Type":"ContainerDied","Data":"b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89"}
Sep 11 16:16:03.621459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.621356    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b404cb816a1221ad542693f74bcd2c3803c2ba662178a559f559bf4af81d9b89"
Sep 11 16:16:03.622946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.622923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" event={"ID":"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3","Type":"ContainerStarted","Data":"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"}
Sep 11 16:16:03.623101 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.623081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:16:03.646657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:03.646601    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" podStartSLOduration=2.08710377 podStartE2EDuration="4.646581727s" totalImagesPullingTime="2.559477957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:03.643634459 +0000 UTC m=+833.905880601" watchObservedRunningTime="2026-09-11 16:16:03.646581727 +0000 UTC m=+833.908827919"
Sep 11 16:16:04.662954 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:04.662909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:05.862693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:05.862655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:06.825891 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:06.825855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:07.285085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:07.285047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:07.757006 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:07.756971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:08.758271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:08.758236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:09.185212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:09.185124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:16:09.635448 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:09.635421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:16:09.819976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:09.819928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:10.664594 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.664490    2564 generic.go:356] "Generic (PLEG): container finished" podID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerID="51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7" exitCode=0
Sep 11 16:16:10.664594 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.664567    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerDied","Data":"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"}
Sep 11 16:16:10.664995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.664977    2564 scope.go:117] "RemoveContainer" containerID="51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"
Sep 11 16:16:10.667142 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.667112    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:10.667210 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.667182    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:10.667247 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.667211    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:10.701909 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.701872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:10.807874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.807827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:10.905812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:10.905773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:11.080645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.080610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:11.186023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.185989    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"]
Sep 11 16:16:11.188736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.188687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:11.191489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.191462    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16046061-vdzrl"]
Sep 11 16:16:11.388240 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.388147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:11.672644 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:11.672556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerStarted","Data":"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"}
Sep 11 16:16:12.000317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.000213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:12.144402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.144361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:16:12.145702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.145675    2564 patch_prober.go:28] interesting pod/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 11 16:16:12.145826 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.145729    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 11 16:16:12.173215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.173185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:12.291306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.291265    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d32c637b-f0f0-4f3d-ae91-8e6f42936866" path="/var/lib/kubelet/pods/d32c637b-f0f0-4f3d-ae91-8e6f42936866/volumes"
Sep 11 16:16:12.326127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.326088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:12.563490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.563391    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:16:12.563896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.563877    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32c637b-f0f0-4f3d-ae91-8e6f42936866" containerName="revoke-keys"
Sep 11 16:16:12.563991 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.563899    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32c637b-f0f0-4f3d-ae91-8e6f42936866" containerName="revoke-keys"
Sep 11 16:16:12.564042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.564009    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d32c637b-f0f0-4f3d-ae91-8e6f42936866" containerName="revoke-keys"
Sep 11 16:16:12.566055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.566034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.572915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.572899    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-02a2f652-gw-openshift-default-dockercfg-jvqnk\""
Sep 11 16:16:12.611640 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.611607    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:16:12.628831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.628797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbn9\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.628831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.628831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629096 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.628860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629096 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.628985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629096 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.629030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.629092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.629142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.629170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.629283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.629192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.700367 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.700322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:12.730184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skbn9\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.730894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.730657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.731087 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.731063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.731291 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.731262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.731459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.731438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.731580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.731561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.733004 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.732977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.733214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.733192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.767857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.767829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.768653 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.768633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbn9\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9\") pod \"e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") " pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:12.880305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:12.880207    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:13.035760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.035723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:13.144488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.144407    2564 patch_prober.go:28] interesting pod/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 11 16:16:13.144488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.144470    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 11 16:16:13.223586 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:16:13.223555    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60337afe_1b6e_4054_acc6_bb578aa42ab9.slice/crio-ededd58717e4c3d329ba3251f7159cf0786798a315de4f119c796137fe3152fd WatchSource:0}: Error finding container ededd58717e4c3d329ba3251f7159cf0786798a315de4f119c796137fe3152fd: Status 404 returned error can't find the container with id ededd58717e4c3d329ba3251f7159cf0786798a315de4f119c796137fe3152fd
Sep 11 16:16:13.224007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.223986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:16:13.226655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.226619    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:13.226797 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.226706    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:13.226797 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.226754    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:13.337825 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.337795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:13.692460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.692417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerStarted","Data":"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"}
Sep 11 16:16:13.692701 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.692488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerStarted","Data":"ededd58717e4c3d329ba3251f7159cf0786798a315de4f119c796137fe3152fd"}
Sep 11 16:16:13.736812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.736751    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podStartSLOduration=1.7367338650000002 podStartE2EDuration="1.736733865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:13.734820118 +0000 UTC m=+843.997066283" watchObservedRunningTime="2026-09-11 16:16:13.736733865 +0000 UTC m=+843.998980007"
Sep 11 16:16:13.881065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:13.881023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:14.145021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:14.144987    2564 patch_prober.go:28] interesting pod/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 11 16:16:14.145391 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:14.145040    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 11 16:16:14.644735 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:14.644701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:14.895926 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:14.895827    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:15.137917 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.137881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:15.144882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.144855    2564 patch_prober.go:28] interesting pod/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 11 16:16:15.145039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.144905    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 11 16:16:15.515001 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.514962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:15.660503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.660454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:15.707025 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.706986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:15.708148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:15.708124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:16.144815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:16.144773    2564 patch_prober.go:28] interesting pod/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 11 16:16:16.145021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:16.144845    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 11 16:16:16.503298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:16.503204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:16:16.956045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:16.956005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:17.149124 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:17.149096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:16:17.150300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:17.150281    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:16:18.727732 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:18.727701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:19.032183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:19.032145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:19.203264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:19.203226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:20.745105 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.745077    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:20.754742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.754719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.757797 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.757764    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-02a2f652-serving-cert\""
Sep 11 16:16:20.761567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.761540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:20.797304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.797265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.797471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.797314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqct\" (UniqueName: \"kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.797471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.797407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.797604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.797487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.819629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.819589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:20.898023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.897989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.898023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.898034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqct\" (UniqueName: \"kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.898295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.898070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.898295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.898129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.898808 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.898785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.900774 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.900751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.900854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.900810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.923029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.923000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqct\" (UniqueName: \"kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct\") pod \"maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:20.985388 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:20.985349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:21.069591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:21.069551    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:21.369063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:21.369037    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:21.370637 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:16:21.370611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3230f51_dfa6_4695_8f08_a96bed3bbce7.slice/crio-bf60dabf0f58a60602fe246da305fe0eaa984b177556af6f07d4fcaaa5c451b8 WatchSource:0}: Error finding container bf60dabf0f58a60602fe246da305fe0eaa984b177556af6f07d4fcaaa5c451b8: Status 404 returned error can't find the container with id bf60dabf0f58a60602fe246da305fe0eaa984b177556af6f07d4fcaaa5c451b8
Sep 11 16:16:21.599317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:21.599288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:21.735634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:21.735545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:21.744830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:21.744802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" event={"ID":"f3230f51-dfa6-4695-8f08-a96bed3bbce7","Type":"ContainerStarted","Data":"bf60dabf0f58a60602fe246da305fe0eaa984b177556af6f07d4fcaaa5c451b8"}
Sep 11 16:16:22.321855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:22.321819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:22.755119 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:22.755037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" event={"ID":"f3230f51-dfa6-4695-8f08-a96bed3bbce7","Type":"ContainerStarted","Data":"e32e0387f6e43a41fe0a27ade62552c2fca3de7171d5c73276cbb181aff3a758"}
Sep 11 16:16:22.755274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:22.755150    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:22.778603 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:22.778552    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" podStartSLOduration=2.185460861 podStartE2EDuration="2.778509814s" totalImagesPullingTime="593.048953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:22.777022367 +0000 UTC m=+853.039268509" watchObservedRunningTime="2026-09-11 16:16:22.778509814 +0000 UTC m=+853.040755955"
Sep 11 16:16:23.362595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:23.362558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:24.552921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:24.552885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:28.766256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:28.766228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:29.696840 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:29.696805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:16:30.626437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:30.626385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:30.826873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:30.826835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:31.057538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:31.057487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:31.351436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:31.351336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:40.001815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.001772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:40.254596 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.254474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:40.868085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.868052    2564 generic.go:356] "Generic (PLEG): container finished" podID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerID="12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2" exitCode=0
Sep 11 16:16:40.868284 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.868129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerDied","Data":"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"}
Sep 11 16:16:40.868581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.868567    2564 scope.go:117] "RemoveContainer" containerID="12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"
Sep 11 16:16:40.869777 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.869743    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:40.869846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.869824    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:40.869884 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:40.869855    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:16:41.875497 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:41.875461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerStarted","Data":"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"}
Sep 11 16:16:41.882450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:41.882404    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:41.882689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:41.882566    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:41.882689 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:41.882617    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:42.886241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:42.886205    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:42.886839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:42.886809    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:43.881562 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:43.881495    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:43.881782 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:43.881590    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:44.409759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:44.409717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:44.881833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:44.881789    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:44.882043 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:44.881862    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:45.707946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:45.707910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:45.745333 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:45.745291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:45.873389 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:45.873348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:45.881397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:45.881362    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:45.881702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:45.881672    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:46.881214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:46.881176    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:16:46.881897 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:46.881864    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:16:47.628085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:47.628052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:47.885226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:47.885135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:47.886937 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:47.886912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:16:49.461409 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:49.461374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:50.148239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:50.148202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:50.909178 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:50.909148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:52.132719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:52.132679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:53.332279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:53.332242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:56.733453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:56.733413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:57.760755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:57.760720    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:57.761118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:57.760929    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" podUID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" containerName="maas-api" containerID="cri-o://e32e0387f6e43a41fe0a27ade62552c2fca3de7171d5c73276cbb181aff3a758" gracePeriod=30
Sep 11 16:16:57.868669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:57.868621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:57.983964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:57.983932    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" containerID="e32e0387f6e43a41fe0a27ade62552c2fca3de7171d5c73276cbb181aff3a758" exitCode=0
Sep 11 16:16:57.984149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:57.984017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" event={"ID":"f3230f51-dfa6-4695-8f08-a96bed3bbce7","Type":"ContainerDied","Data":"e32e0387f6e43a41fe0a27ade62552c2fca3de7171d5c73276cbb181aff3a758"}
Sep 11 16:16:58.031327 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.031305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:58.146171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.146137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:58.156116 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.156080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sqct\" (UniqueName: \"kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct\") pod \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") "
Sep 11 16:16:58.156279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.156129    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls\") pod \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") "
Sep 11 16:16:58.156279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.156208    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca\") pod \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") "
Sep 11 16:16:58.156279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.156248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs\") pod \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\" (UID: \"f3230f51-dfa6-4695-8f08-a96bed3bbce7\") "
Sep 11 16:16:58.156627 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.156592    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3230f51-dfa6-4695-8f08-a96bed3bbce7" (UID: "f3230f51-dfa6-4695-8f08-a96bed3bbce7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:16:58.158448 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.158428    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3230f51-dfa6-4695-8f08-a96bed3bbce7" (UID: "f3230f51-dfa6-4695-8f08-a96bed3bbce7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:16:58.159022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.159000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3230f51-dfa6-4695-8f08-a96bed3bbce7" (UID: "f3230f51-dfa6-4695-8f08-a96bed3bbce7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:16:58.159022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.159007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct" (OuterVolumeSpecName: "kube-api-access-7sqct") pod "f3230f51-dfa6-4695-8f08-a96bed3bbce7" (UID: "f3230f51-dfa6-4695-8f08-a96bed3bbce7"). InnerVolumeSpecName "kube-api-access-7sqct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:16:58.257743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.257706    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3230f51-dfa6-4695-8f08-a96bed3bbce7-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:16:58.257743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.257737    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:16:58.257743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.257747    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sqct\" (UniqueName: \"kubernetes.io/projected/f3230f51-dfa6-4695-8f08-a96bed3bbce7-kube-api-access-7sqct\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:16:58.257969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.257757    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3230f51-dfa6-4695-8f08-a96bed3bbce7-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:16:58.393005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.392963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:58.596792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.596706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:58.628221 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.628187    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:16:58.628400 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.628381    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" containerID="cri-o://7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef" gracePeriod=30
Sep 11 16:16:58.723337 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.723302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:58.990931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.990848    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"
Sep 11 16:16:58.990931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.990878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b" event={"ID":"f3230f51-dfa6-4695-8f08-a96bed3bbce7","Type":"ContainerDied","Data":"bf60dabf0f58a60602fe246da305fe0eaa984b177556af6f07d4fcaaa5c451b8"}
Sep 11 16:16:58.991397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:58.990938    2564 scope.go:117] "RemoveContainer" containerID="e32e0387f6e43a41fe0a27ade62552c2fca3de7171d5c73276cbb181aff3a758"
Sep 11 16:16:59.056375 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.056346    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:59.077301 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.077272    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02a2f652-5d688458b9-55x5b"]
Sep 11 16:16:59.255308 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.255224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:59.534556 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.534501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:59.848340 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.848261    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:16:59.848679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.848666    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" containerName="maas-api"
Sep 11 16:16:59.848730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.848681    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" containerName="maas-api"
Sep 11 16:16:59.848766 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.848758    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" containerName="maas-api"
Sep 11 16:16:59.853150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.853132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.857837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.857817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-28f629bb-openshift-default-dockercfg-jnzk8\""
Sep 11 16:16:59.913829 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.913796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:16:59.948537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.948483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:16:59.974942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.974899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh92p\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:16:59.975455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:16:59.975420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh92p\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.076666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.077010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.077010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.077010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.077010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.076976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.077166 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.077011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.078933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.078912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.079259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.079235    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.093283 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.093253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.095411 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.095389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh92p\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p\") pod \"e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") " pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.165111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.165021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:00.273081 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.273042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:00.288128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.288091    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3230f51-dfa6-4695-8f08-a96bed3bbce7" path="/var/lib/kubelet/pods/f3230f51-dfa6-4695-8f08-a96bed3bbce7/volumes"
Sep 11 16:17:00.473186 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.473161    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:17:00.475566 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:17:00.475534    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff1041f_5441_4b03_8a8d_e1df6041869e.slice/crio-4fba443d693c069768d1ad8705e856b6126e41bad7ef3f444401e6f945ed32a1 WatchSource:0}: Error finding container 4fba443d693c069768d1ad8705e856b6126e41bad7ef3f444401e6f945ed32a1: Status 404 returned error can't find the container with id 4fba443d693c069768d1ad8705e856b6126e41bad7ef3f444401e6f945ed32a1
Sep 11 16:17:00.477941 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.477905    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:00.478041 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.477994    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:00.478085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:00.478039    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:01.011584 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.011483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerStarted","Data":"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"}
Sep 11 16:17:01.011757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.011591    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerStarted","Data":"4fba443d693c069768d1ad8705e856b6126e41bad7ef3f444401e6f945ed32a1"}
Sep 11 16:17:01.061922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.061866    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podStartSLOduration=2.061848422 podStartE2EDuration="2.061848422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:17:01.061039812 +0000 UTC m=+891.323285967" watchObservedRunningTime="2026-09-11 16:17:01.061848422 +0000 UTC m=+891.324094564"
Sep 11 16:17:01.128923 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.128885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:01.166185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.166147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:01.171832 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:01.171805    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:02.017845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.017806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:02.018764 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.018744    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:02.355561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.355430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:02.544551 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.544498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:02.715928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.715817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:02.888816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.888784    2564 patch_prober.go:28] interesting pod/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:17:02.888980 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:02.888834    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:17:03.591541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:03.591488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:03.886727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:03.886685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:17:04.018138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skbn9\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018185    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018230    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018258    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018329    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018438    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket\") pod \"60337afe-1b6e-4054-acc6-bb578aa42ab9\" (UID: \"60337afe-1b6e-4054-acc6-bb578aa42ab9\") "
Sep 11 16:17:04.018781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:04.018781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018760    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:17:04.018896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018876    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data" (OuterVolumeSpecName: "istio-data") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:04.019011 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.018989    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:04.019089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.019012    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:04.021259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.021230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token" (OuterVolumeSpecName: "istio-token") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:17:04.021259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.021249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9" (OuterVolumeSpecName: "kube-api-access-skbn9") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "kube-api-access-skbn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:17:04.021427 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.021335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:04.021427 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.021346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60337afe-1b6e-4054-acc6-bb578aa42ab9" (UID: "60337afe-1b6e-4054-acc6-bb578aa42ab9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:17:04.033013 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.032977    2564 generic.go:356] "Generic (PLEG): container finished" podID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerID="7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef" exitCode=0
Sep 11 16:17:04.033179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.033030    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"
Sep 11 16:17:04.033179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.033057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerDied","Data":"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"}
Sep 11 16:17:04.033179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.033120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc" event={"ID":"60337afe-1b6e-4054-acc6-bb578aa42ab9","Type":"ContainerDied","Data":"ededd58717e4c3d329ba3251f7159cf0786798a315de4f119c796137fe3152fd"}
Sep 11 16:17:04.033179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.033150    2564 scope.go:117] "RemoveContainer" containerID="7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"
Sep 11 16:17:04.044099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.044076    2564 scope.go:117] "RemoveContainer" containerID="12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"
Sep 11 16:17:04.053857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.053834    2564 scope.go:117] "RemoveContainer" containerID="7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"
Sep 11 16:17:04.054168 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:17:04.054148    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef\": container with ID starting with 7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef not found: ID does not exist" containerID="7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"
Sep 11 16:17:04.054248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.054176    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef"} err="failed to get container status \"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef\": rpc error: code = NotFound desc = could not find container \"7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef\": container with ID starting with 7fef7a15fb34270558af1e505ccae4e6ae96e985d58668dffbcc507045c602ef not found: ID does not exist"
Sep 11 16:17:04.054248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.054193    2564 scope.go:117] "RemoveContainer" containerID="12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"
Sep 11 16:17:04.054446 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:17:04.054432    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2\": container with ID starting with 12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2 not found: ID does not exist" containerID="12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"
Sep 11 16:17:04.054487 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.054449    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2"} err="failed to get container status \"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2\": rpc error: code = NotFound desc = could not find container \"12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2\": container with ID starting with 12e5c2d57700c6b6a45747bdbc82360c060e653e5a0a99e139bcbf9e935a00b2 not found: ID does not exist"
Sep 11 16:17:04.068989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.068953    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:17:04.075500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.075465    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-02a2f652-gw-openshift-default-84567d9b8d-7njtc"]
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120150    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120185    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120197    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120210    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120221    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skbn9\" (UniqueName: \"kubernetes.io/projected/60337afe-1b6e-4054-acc6-bb578aa42ab9-kube-api-access-skbn9\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120235    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120250    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120263    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60337afe-1b6e-4054-acc6-bb578aa42ab9-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.120586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.120275    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60337afe-1b6e-4054-acc6-bb578aa42ab9-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:04.287192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.287159    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" path="/var/lib/kubelet/pods/60337afe-1b6e-4054-acc6-bb578aa42ab9/volumes"
Sep 11 16:17:04.718664 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.718623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:04.816383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.816350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:04.925844 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:04.925810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:05.400088 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:05.400045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:05.592852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:05.592812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:05.631313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:05.631275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:17:06.170390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:06.170352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:07.798257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:07.798223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:08.227740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:08.227653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:09.550076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:09.550034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:10.249401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:10.249374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:17:10.252584 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:10.252563    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:17:20.504241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:20.504153    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:17:23.111426 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.111388    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:17:23.111852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.111835    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:23.111903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.111854    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:23.111952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.111943    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:23.116326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.116308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.120413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.120392    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-1e9d2637-kserve-self-signed-certs\""
Sep 11 16:17:23.140364 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.140329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:17:23.193795 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.193763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:23.207943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.207900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.207943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.207948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.208154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.207970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.208154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.208002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.208154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.208096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.208154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.208145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309379 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.309825 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.309797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.310320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.310084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.310506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.310483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.311964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.311945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.312883 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.312864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.358464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.358423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk\") pod \"e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") " pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.426290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.426180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:23.710988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:23.710959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:17:23.713721 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:17:23.713693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdae0539_57ce_41bd_a2ff_c81a5de536f6.slice/crio-e92f1d935a4230bd702484ff7614d2c2a867a86f9b78b10bb0135bdd3a1856a5 WatchSource:0}: Error finding container e92f1d935a4230bd702484ff7614d2c2a867a86f9b78b10bb0135bdd3a1856a5: Status 404 returned error can't find the container with id e92f1d935a4230bd702484ff7614d2c2a867a86f9b78b10bb0135bdd3a1856a5
Sep 11 16:17:24.162133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.162096    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerID="808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42" exitCode=0
Sep 11 16:17:24.162609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.162170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerDied","Data":"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"}
Sep 11 16:17:24.162729 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.162711    2564 scope.go:117] "RemoveContainer" containerID="808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"
Sep 11 16:17:24.163970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.163941    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:24.164084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.164019    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:24.164084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.164054    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:24.164084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.164059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" event={"ID":"bdae0539-57ce-41bd-a2ff-c81a5de536f6","Type":"ContainerStarted","Data":"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"}
Sep 11 16:17:24.164268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.164088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" event={"ID":"bdae0539-57ce-41bd-a2ff-c81a5de536f6","Type":"ContainerStarted","Data":"e92f1d935a4230bd702484ff7614d2c2a867a86f9b78b10bb0135bdd3a1856a5"}
Sep 11 16:17:24.244471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:24.244407    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" podStartSLOduration=1.244386083 podStartE2EDuration="1.244386083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:17:24.2432789 +0000 UTC m=+914.505525046" watchObservedRunningTime="2026-09-11 16:17:24.244386083 +0000 UTC m=+914.506632227"
Sep 11 16:17:25.172277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:25.172238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerStarted","Data":"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"}
Sep 11 16:17:25.205049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:25.205007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:25.600055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:25.600013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:26.166053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:26.166020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:26.166272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:26.166248    2564 patch_prober.go:28] interesting pod/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:17:26.166337 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:26.166318    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 16:17:27.165588 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:27.165548    2564 patch_prober.go:28] interesting pod/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:17:27.165968 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:27.165618    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 16:17:27.554805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:27.554774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:28.165662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:28.165623    2564 patch_prober.go:28] interesting pod/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:17:28.166155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:28.165699    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 16:17:28.569505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:28.569472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:29.165469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:29.165431    2564 patch_prober.go:28] interesting pod/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:17:29.165672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:29.165494    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 16:17:29.715563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:29.715502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:30.165995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:30.165958    2564 patch_prober.go:28] interesting pod/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:17:30.166175 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:30.166015    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 16:17:30.557671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:30.557632    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:31.170331 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:31.170301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:31.170712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:31.170624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:31.171444 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:31.171429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:31.659361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:31.659331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:32.624954 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:32.624900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:33.426661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:33.426624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:33.426830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:33.426691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:33.439188 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:33.439163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:34.066667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:34.066634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:34.252809 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:34.252780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:17:35.120664 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:35.120627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:35.245890 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:35.245850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:35.342724 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:35.342690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:35.444317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:35.444223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:35.944932 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:35.944891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:36.600953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:36.600921    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:17:36.601332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:36.601149    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy" containerID="cri-o://422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea" gracePeriod=30
Sep 11 16:17:36.626110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:36.626075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:36.961590 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:36.961490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:37.087229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.087192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:37.329474 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.329442    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:17:37.330031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.330015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:37.330078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.330035    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:37.330160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.330149    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="60337afe-1b6e-4054-acc6-bb578aa42ab9" containerName="istio-proxy"
Sep 11 16:17:37.333545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.333496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.343433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.343415    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a9b1abbc-openshift-default-dockercfg-wfqh5\""
Sep 11 16:17:37.400695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.400659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:37.426816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.426781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:17:37.445609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.445798 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.445868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.445927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.445927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.446065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nc8k\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.446065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.446065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.445997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.446212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.446089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547018 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.546983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547294 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nc8k\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.547567 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.547511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.548150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.548118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.548252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.548127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.548401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.548371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.548649 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.548622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.550922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.550893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.556187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.556159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.558277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.558140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.559267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.559244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nc8k\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k\") pod \"e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") " pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.646713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.646616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:37.834149 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.834110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:37.931076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.931050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:17:37.933037 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:17:37.933003    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb266202a_f895_4166_8bbd_61f114bbabc4.slice/crio-0781dd33a0f0f49d825b0d512a5be25a49af2d2edaf44d14c2ffec8545cb07cd WatchSource:0}: Error finding container 0781dd33a0f0f49d825b0d512a5be25a49af2d2edaf44d14c2ffec8545cb07cd: Status 404 returned error can't find the container with id 0781dd33a0f0f49d825b0d512a5be25a49af2d2edaf44d14c2ffec8545cb07cd
Sep 11 16:17:37.935541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.935481    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:37.935622 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.935597    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:37.935664 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:37.935640    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:17:38.060684 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.060646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:38.267749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.267714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerStarted","Data":"b843cef77a2a65c6b8410e821fb0c0d53f2bc35e26a9a36c867a98f0bb856cc5"}
Sep 11 16:17:38.267922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.267768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerStarted","Data":"0781dd33a0f0f49d825b0d512a5be25a49af2d2edaf44d14c2ffec8545cb07cd"}
Sep 11 16:17:38.319875 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.319825    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podStartSLOduration=1.319808396 podStartE2EDuration="1.319808396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:17:38.318734289 +0000 UTC m=+928.580980438" watchObservedRunningTime="2026-09-11 16:17:38.319808396 +0000 UTC m=+928.582054538"
Sep 11 16:17:38.647036 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.646943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:38.652200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:38.652172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:39.274580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:39.274549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:39.275436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:39.275415    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:17:39.369066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:39.369036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:39.764977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:39.764944    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:17:39.908239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:39.908195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:40.105813 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:40.105721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:41.027645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.027614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:41.855550 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.855510    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:41.990343 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh92p\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990343 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990351    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990392    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990420    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990452    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990473    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990558    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs\") pod \"4ff1041f-5441-4b03-8a8d-e1df6041869e\" (UID: \"4ff1041f-5441-4b03-8a8d-e1df6041869e\") "
Sep 11 16:17:41.990989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990724    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:41.990989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990957    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:41.990989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990959    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:41.990989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990972    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:41.991366 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.990995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:41.991471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.991447    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:17:41.992868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.992768    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:17:41.992868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.992838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p" (OuterVolumeSpecName: "kube-api-access-bh92p") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "kube-api-access-bh92p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:17:41.993218 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.993197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:17:41.993278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:41.993216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ff1041f-5441-4b03-8a8d-e1df6041869e" (UID: "4ff1041f-5441-4b03-8a8d-e1df6041869e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:17:42.091765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091731    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.091765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091758    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.091765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091774    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.092206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091783    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ff1041f-5441-4b03-8a8d-e1df6041869e-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.092206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091791    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ff1041f-5441-4b03-8a8d-e1df6041869e-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.092206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091800    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh92p\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-kube-api-access-bh92p\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.092206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091809    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.092206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.091817    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ff1041f-5441-4b03-8a8d-e1df6041869e-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:17:42.295618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.295578    2564 generic.go:356] "Generic (PLEG): container finished" podID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerID="422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea" exitCode=0
Sep 11 16:17:42.295789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.295631    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"
Sep 11 16:17:42.295789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.295670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerDied","Data":"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"}
Sep 11 16:17:42.295789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.295730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575" event={"ID":"4ff1041f-5441-4b03-8a8d-e1df6041869e","Type":"ContainerDied","Data":"4fba443d693c069768d1ad8705e856b6126e41bad7ef3f444401e6f945ed32a1"}
Sep 11 16:17:42.295789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.295752    2564 scope.go:117] "RemoveContainer" containerID="422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"
Sep 11 16:17:42.305589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.305570    2564 scope.go:117] "RemoveContainer" containerID="808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"
Sep 11 16:17:42.314548 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.314529    2564 scope.go:117] "RemoveContainer" containerID="422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"
Sep 11 16:17:42.314850 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:17:42.314831    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea\": container with ID starting with 422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea not found: ID does not exist" containerID="422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"
Sep 11 16:17:42.314907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.314857    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea"} err="failed to get container status \"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea\": rpc error: code = NotFound desc = could not find container \"422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea\": container with ID starting with 422919776cd599fc453a05d208a79bec367ea7558803c645a100b039c666b9ea not found: ID does not exist"
Sep 11 16:17:42.314907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.314873    2564 scope.go:117] "RemoveContainer" containerID="808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"
Sep 11 16:17:42.315136 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:17:42.315118    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42\": container with ID starting with 808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42 not found: ID does not exist" containerID="808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"
Sep 11 16:17:42.315180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.315142    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42"} err="failed to get container status \"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42\": rpc error: code = NotFound desc = could not find container \"808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42\": container with ID starting with 808e754cfdb1fcfc05c91c6217beb6c08f95535ab36279c64404a7234c867f42 not found: ID does not exist"
Sep 11 16:17:42.329292 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.329263    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:17:42.342507 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.342479    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-28f629bb-openshift-default-694ff8fbdb-qv575"]
Sep 11 16:17:42.608267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:42.608179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:44.013039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:44.013007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:44.287172 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:44.287080    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" path="/var/lib/kubelet/pods/4ff1041f-5441-4b03-8a8d-e1df6041869e/volumes"
Sep 11 16:17:45.805461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:45.805408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:45.998065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:45.998026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:46.106068 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:46.105968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:59.774091 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774051    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774448    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774460    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774474    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774480    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774561    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.774796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.774572    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff1041f-5441-4b03-8a8d-e1df6041869e" containerName="istio-proxy"
Sep 11 16:17:59.779471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.779450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.791024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.790995    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-e12be0\"/\"kube-root-ca.crt\""
Sep 11 16:17:59.791177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.791071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-e12be0\"/\"default-dockercfg-z6vn6\""
Sep 11 16:17:59.791250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.790994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-e12be0\"/\"openshift-service-ca.crt\""
Sep 11 16:17:59.791497 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.791474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-e12be0\"/\"autores-model-e12be0-kserve-self-signed-certs\""
Sep 11 16:17:59.795155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.795128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:17:59.805408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.805376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:17:59.880318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.880318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.880641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.880641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.880641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.880641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.880494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtl4\" (UniqueName: \"kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.981712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.981671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.981989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.981740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.981989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.981787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.981989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.981844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.982177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.982156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.982263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.982237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtl4\" (UniqueName: \"kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.982359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.982157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.982461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.982349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.982836 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.982811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.984717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.984683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.985140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.985119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:17:59.992321 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:17:59.992295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtl4\" (UniqueName: \"kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4\") pod \"autores-model-e12be0-kserve-68c9cd4cf5-5tqk2\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") " pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:00.098167 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:00.098079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:00.386798 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:00.386765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:18:00.387626 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:18:00.387592    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e8c4174_8f9a_44b9_bd51_eca54f040291.slice/crio-be30588e841addade22e5be1ffe81fa7fb75f29ac44f7cc07ca1201df2ca8bcf WatchSource:0}: Error finding container be30588e841addade22e5be1ffe81fa7fb75f29ac44f7cc07ca1201df2ca8bcf: Status 404 returned error can't find the container with id be30588e841addade22e5be1ffe81fa7fb75f29ac44f7cc07ca1201df2ca8bcf
Sep 11 16:18:00.412146 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:00.412104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" event={"ID":"5e8c4174-8f9a-44b9-bd51-eca54f040291","Type":"ContainerStarted","Data":"be30588e841addade22e5be1ffe81fa7fb75f29ac44f7cc07ca1201df2ca8bcf"}
Sep 11 16:18:00.666894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:00.666793    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:18:01.421270 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:01.421239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" event={"ID":"5e8c4174-8f9a-44b9-bd51-eca54f040291","Type":"ContainerStarted","Data":"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"}
Sep 11 16:18:01.441251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:01.441202    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" podStartSLOduration=2.441184078 podStartE2EDuration="2.441184078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:18:01.440535458 +0000 UTC m=+951.702781595" watchObservedRunningTime="2026-09-11 16:18:01.441184078 +0000 UTC m=+951.703430244"
Sep 11 16:18:02.428816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.428784    2564 generic.go:356] "Generic (PLEG): container finished" podID="b266202a-f895-4166-8bbd-61f114bbabc4" containerID="b843cef77a2a65c6b8410e821fb0c0d53f2bc35e26a9a36c867a98f0bb856cc5" exitCode=0
Sep 11 16:18:02.429206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.428860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerDied","Data":"b843cef77a2a65c6b8410e821fb0c0d53f2bc35e26a9a36c867a98f0bb856cc5"}
Sep 11 16:18:02.429362 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.429344    2564 scope.go:117] "RemoveContainer" containerID="b843cef77a2a65c6b8410e821fb0c0d53f2bc35e26a9a36c867a98f0bb856cc5"
Sep 11 16:18:02.430604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.430580    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:02.430675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.430662    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:02.430712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:02.430697    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:03.441725 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:03.441690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerStarted","Data":"109de91ad081f4aaee45d16dbcabacee9c8b1d788d2bc3df3df86ab4161629d3"}
Sep 11 16:18:03.647448 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:03.647411    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:03.647694 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:03.647668    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:03.647788 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:03.647761    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:04.647876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:04.647833    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:04.648381 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:04.647912    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:05.647726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:05.647680    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:05.647917 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:05.647767    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:06.647117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:06.647079    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:06.647298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:06.647132    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:07.647415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:07.647377    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:07.647842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:07.647441    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:08.647184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:08.647146    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 16:18:08.647394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:08.647207    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 16:18:09.275400 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:09.275367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:09.651675 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:09.651595    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:09.652473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:09.652450    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:10.099023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:10.098984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:10.099216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:10.099043    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:10.112042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:10.112010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:10.457514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:10.457422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:10.496668 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:10.496635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:11.492268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:11.492225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:12.411073 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:12.411041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:13.462555 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:13.462506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:14.459573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:14.459533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:15.225711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:15.225672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:17.282740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:17.282706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:18:21.976961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:21.976927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:22.080374 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.080339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:22.179587 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.179531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:22.264101 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.264073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:22.404211 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.404169    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:18:22.404450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.404425    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" containerID="cri-o://109de91ad081f4aaee45d16dbcabacee9c8b1d788d2bc3df3df86ab4161629d3" gracePeriod=30
Sep 11 16:18:22.413313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.413287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:22.852935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:22.852897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:23.115453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:23.115363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:23.225476 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:23.225442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:24.050974 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:24.050938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:24.654069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:24.654040    2564 patch_prober.go:28] interesting pod/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:18:24.654436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:24.654099    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:18:24.710888 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:24.710852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:25.014913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:25.014881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:25.677691 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:25.677656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:26.148140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:26.148097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:27.587328 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.587290    2564 generic.go:356] "Generic (PLEG): container finished" podID="b266202a-f895-4166-8bbd-61f114bbabc4" containerID="109de91ad081f4aaee45d16dbcabacee9c8b1d788d2bc3df3df86ab4161629d3" exitCode=0
Sep 11 16:18:27.587801 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.587371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerDied","Data":"109de91ad081f4aaee45d16dbcabacee9c8b1d788d2bc3df3df86ab4161629d3"}
Sep 11 16:18:27.587801 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.587446    2564 scope.go:117] "RemoveContainer" containerID="b843cef77a2a65c6b8410e821fb0c0d53f2bc35e26a9a36c867a98f0bb856cc5"
Sep 11 16:18:27.658752 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.658728    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:27.661696 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661679    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.661767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661724    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.661767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661747    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nc8k\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.661879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.661879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661822    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.661879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661869    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.662035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661914    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.662035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661964    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.662035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661963    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:27.662035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.661989    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:27.662229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo\") pod \"b266202a-f895-4166-8bbd-61f114bbabc4\" (UID: \"b266202a-f895-4166-8bbd-61f114bbabc4\") "
Sep 11 16:18:27.662229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:27.662229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:27.662388 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662347    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:27.662432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662407    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.662432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662429    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.662502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662443    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.662502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.662456    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.664195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.664163    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k" (OuterVolumeSpecName: "kube-api-access-5nc8k") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "kube-api-access-5nc8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:27.664300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.664221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:27.664683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.664663    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:18:27.664683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.664676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b266202a-f895-4166-8bbd-61f114bbabc4" (UID: "b266202a-f895-4166-8bbd-61f114bbabc4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:27.763434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.763397    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b266202a-f895-4166-8bbd-61f114bbabc4-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.763434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.763425    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b266202a-f895-4166-8bbd-61f114bbabc4-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.763434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.763433    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.763434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.763442    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b266202a-f895-4166-8bbd-61f114bbabc4-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:27.763753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:27.763450    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nc8k\" (UniqueName: \"kubernetes.io/projected/b266202a-f895-4166-8bbd-61f114bbabc4-kube-api-access-5nc8k\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:28.085127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.085081    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:18:28.133407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.133369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:28.594661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.594630    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"
Sep 11 16:18:28.595143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.594668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6" event={"ID":"b266202a-f895-4166-8bbd-61f114bbabc4","Type":"ContainerDied","Data":"0781dd33a0f0f49d825b0d512a5be25a49af2d2edaf44d14c2ffec8545cb07cd"}
Sep 11 16:18:28.595143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.594730    2564 scope.go:117] "RemoveContainer" containerID="109de91ad081f4aaee45d16dbcabacee9c8b1d788d2bc3df3df86ab4161629d3"
Sep 11 16:18:28.631460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.631425    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:18:28.643981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.643949    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a9b1abbc-openshift-default-957b59784-8sxr6"]
Sep 11 16:18:28.824278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.824246    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:18:28.864874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:28.864793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:29.897427 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:29.897385    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:18:29.928642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:29.928600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:30.186139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:30.186041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:30.287019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:30.286988    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" path="/var/lib/kubelet/pods/b266202a-f895-4166-8bbd-61f114bbabc4/volumes"
Sep 11 16:18:31.192466 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:31.192383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:31.581219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:31.581174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:18:32.276982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:32.276952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:33.509399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:33.509361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:33.612793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:33.612756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:33.722219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:33.722185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:33.825484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:33.825390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:34.195010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:34.194909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:34.771027 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:34.770985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:40.595913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:40.595875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:40.710817 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:40.710788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:40.806029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:40.805995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:40.989296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:40.989210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:41.218480 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:41.218441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:41.444200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:41.444169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:42.543493 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:42.543434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:43.104904 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.104865    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" podUID="f8373125-3a64-4970-a730-14778c642e7c" containerName="main" containerID="cri-o://93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d" gracePeriod=45
Sep 11 16:18:43.339495 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.339462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:43.355062 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.355004    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:18:43.415360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415364    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415440    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjv5m\" (UniqueName: \"kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m\") pod \"f8373125-3a64-4970-a730-14778c642e7c\" (UID: \"f8373125-3a64-4970-a730-14778c642e7c\") "
Sep 11 16:18:43.415842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415644    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:43.415842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415723    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:43.415842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.415762    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home" (OuterVolumeSpecName: "home") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:43.416034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.416016    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.416094 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.416035    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.416094 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.416045    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.417816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.417796    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm" (OuterVolumeSpecName: "dshm") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:43.417936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.417907    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m" (OuterVolumeSpecName: "kube-api-access-mjv5m") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "kube-api-access-mjv5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:43.417981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.417959    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f8373125-3a64-4970-a730-14778c642e7c" (UID: "f8373125-3a64-4970-a730-14778c642e7c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:18:43.517075 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.517035    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8373125-3a64-4970-a730-14778c642e7c-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.517075 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.517071    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8373125-3a64-4970-a730-14778c642e7c-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.517290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.517087    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjv5m\" (UniqueName: \"kubernetes.io/projected/f8373125-3a64-4970-a730-14778c642e7c-kube-api-access-mjv5m\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:43.690482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.690388    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8373125-3a64-4970-a730-14778c642e7c" containerID="93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d" exitCode=0
Sep 11 16:18:43.690482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.690441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"
Sep 11 16:18:43.690482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.690469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" event={"ID":"f8373125-3a64-4970-a730-14778c642e7c","Type":"ContainerDied","Data":"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"}
Sep 11 16:18:43.691090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.690510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht" event={"ID":"f8373125-3a64-4970-a730-14778c642e7c","Type":"ContainerDied","Data":"13d0b4937a42dd8f67bad7d2f726586fbe7b6e581bb0ac949aaa4f232a21da2f"}
Sep 11 16:18:43.691090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.690550    2564 scope.go:117] "RemoveContainer" containerID="93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"
Sep 11 16:18:43.700773 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.700754    2564 scope.go:117] "RemoveContainer" containerID="93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"
Sep 11 16:18:43.701106 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:18:43.701082    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d\": container with ID starting with 93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d not found: ID does not exist" containerID="93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"
Sep 11 16:18:43.701216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.701114    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d"} err="failed to get container status \"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d\": rpc error: code = NotFound desc = could not find container \"93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d\": container with ID starting with 93b25bdc3c0196ac4349f3eeeb1ff34d6fac13c80704f52bd1971ffe1212ea3d not found: ID does not exist"
Sep 11 16:18:43.722860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.722829    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:18:43.729959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.729925    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-1e9d2637-kserve-cfbf7d578-fz2ht"]
Sep 11 16:18:43.843950 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:43.843898    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" podUID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" containerName="main" containerID="cri-o://067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb" gracePeriod=45
Sep 11 16:18:44.083925 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.083898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:18:44.123604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.123760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123634    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.123760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123652    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.123885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:44.123973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123947    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:44.124026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.123975    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.125805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.125786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm" (OuterVolumeSpecName: "dshm") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:44.224514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.224514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.224796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs\") pod \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\" (UID: \"bdae0539-57ce-41bd-a2ff-c81a5de536f6\") "
Sep 11 16:18:44.224796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home" (OuterVolumeSpecName: "home") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:44.224918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224830    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.224918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224841    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.224918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.224849    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdae0539-57ce-41bd-a2ff-c81a5de536f6-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.226879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.226848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:18:44.226879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.226854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk" (OuterVolumeSpecName: "kube-api-access-9tcnk") pod "bdae0539-57ce-41bd-a2ff-c81a5de536f6" (UID: "bdae0539-57ce-41bd-a2ff-c81a5de536f6"). InnerVolumeSpecName "kube-api-access-9tcnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:44.286492 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.286457    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8373125-3a64-4970-a730-14778c642e7c" path="/var/lib/kubelet/pods/f8373125-3a64-4970-a730-14778c642e7c/volumes"
Sep 11 16:18:44.325765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.325733    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdae0539-57ce-41bd-a2ff-c81a5de536f6-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.325765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.325758    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tcnk\" (UniqueName: \"kubernetes.io/projected/bdae0539-57ce-41bd-a2ff-c81a5de536f6-kube-api-access-9tcnk\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:44.697990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.697955    2564 generic.go:356] "Generic (PLEG): container finished" podID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" containerID="067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb" exitCode=0
Sep 11 16:18:44.698460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.697999    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"
Sep 11 16:18:44.698460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.698046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" event={"ID":"bdae0539-57ce-41bd-a2ff-c81a5de536f6","Type":"ContainerDied","Data":"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"}
Sep 11 16:18:44.698460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.698092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l" event={"ID":"bdae0539-57ce-41bd-a2ff-c81a5de536f6","Type":"ContainerDied","Data":"e92f1d935a4230bd702484ff7614d2c2a867a86f9b78b10bb0135bdd3a1856a5"}
Sep 11 16:18:44.698460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.698115    2564 scope.go:117] "RemoveContainer" containerID="067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"
Sep 11 16:18:44.707570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.707553    2564 scope.go:117] "RemoveContainer" containerID="067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"
Sep 11 16:18:44.707865 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:18:44.707833    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb\": container with ID starting with 067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb not found: ID does not exist" containerID="067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"
Sep 11 16:18:44.707972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.707862    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb"} err="failed to get container status \"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb\": rpc error: code = NotFound desc = could not find container \"067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb\": container with ID starting with 067425a7e4f7ef7019df3c50027f768c81229dbab6a6d940c458c3e551c280bb not found: ID does not exist"
Sep 11 16:18:44.721651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.721624    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:18:44.725923 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.725900    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-1e9d2637-kserve-5f875b7bc6-s5x9l"]
Sep 11 16:18:44.916835 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:44.916787    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" podUID="5e8c4174-8f9a-44b9-bd51-eca54f040291" containerName="main" containerID="cri-o://43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25" gracePeriod=45
Sep 11 16:18:45.186403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.186378    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:45.235417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235384    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235427    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235505    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xtl4\" (UniqueName: \"kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235627    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home\") pod \"5e8c4174-8f9a-44b9-bd51-eca54f040291\" (UID: \"5e8c4174-8f9a-44b9-bd51-eca54f040291\") "
Sep 11 16:18:45.235946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:45.235946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:45.236066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.235973    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home" (OuterVolumeSpecName: "home") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:45.236066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.236020    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.236066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.236038    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.237922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.237900    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm" (OuterVolumeSpecName: "dshm") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:45.238243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.238225    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:18:45.238287 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.238236    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4" (OuterVolumeSpecName: "kube-api-access-8xtl4") pod "5e8c4174-8f9a-44b9-bd51-eca54f040291" (UID: "5e8c4174-8f9a-44b9-bd51-eca54f040291"). InnerVolumeSpecName "kube-api-access-8xtl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:45.337290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.337205    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e8c4174-8f9a-44b9-bd51-eca54f040291-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.337290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.337238    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xtl4\" (UniqueName: \"kubernetes.io/projected/5e8c4174-8f9a-44b9-bd51-eca54f040291-kube-api-access-8xtl4\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.337290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.337254    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.337290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.337269    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e8c4174-8f9a-44b9-bd51-eca54f040291-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:45.705347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.705254    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e8c4174-8f9a-44b9-bd51-eca54f040291" containerID="43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25" exitCode=0
Sep 11 16:18:45.705347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.705308    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"
Sep 11 16:18:45.705878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.705340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" event={"ID":"5e8c4174-8f9a-44b9-bd51-eca54f040291","Type":"ContainerDied","Data":"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"}
Sep 11 16:18:45.705878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.705383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2" event={"ID":"5e8c4174-8f9a-44b9-bd51-eca54f040291","Type":"ContainerDied","Data":"be30588e841addade22e5be1ffe81fa7fb75f29ac44f7cc07ca1201df2ca8bcf"}
Sep 11 16:18:45.705878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.705399    2564 scope.go:117] "RemoveContainer" containerID="43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"
Sep 11 16:18:45.715125 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.715109    2564 scope.go:117] "RemoveContainer" containerID="43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"
Sep 11 16:18:45.715377 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:18:45.715358    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25\": container with ID starting with 43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25 not found: ID does not exist" containerID="43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"
Sep 11 16:18:45.715426 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.715385    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25"} err="failed to get container status \"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25\": rpc error: code = NotFound desc = could not find container \"43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25\": container with ID starting with 43022ff4a20d9bbb08001303da415f300fa551c80b91f47a8922454dc9b80f25 not found: ID does not exist"
Sep 11 16:18:45.731196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.731167    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:18:45.737697 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:45.737671    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-e12be0/autores-model-e12be0-kserve-68c9cd4cf5-5tqk2"]
Sep 11 16:18:46.286350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:46.286318    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e8c4174-8f9a-44b9-bd51-eca54f040291" path="/var/lib/kubelet/pods/5e8c4174-8f9a-44b9-bd51-eca54f040291/volumes"
Sep 11 16:18:46.286740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:46.286727    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" path="/var/lib/kubelet/pods/bdae0539-57ce-41bd-a2ff-c81a5de536f6/volumes"
Sep 11 16:18:47.457617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:47.457588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:47.631464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:47.631430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:47.768430 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:47.768395    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:18:47.768676 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:47.768650    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy" containerID="cri-o://d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797" gracePeriod=30
Sep 11 16:18:47.816368 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:47.816330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:48.084725 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.084633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:18:48.169488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.169450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:48.456965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.456872    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:18:48.457325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457308    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:48.457413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457329    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:48.457413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457358    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8373125-3a64-4970-a730-14778c642e7c" containerName="main"
Sep 11 16:18:48.457413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457366    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8373125-3a64-4970-a730-14778c642e7c" containerName="main"
Sep 11 16:18:48.457413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457392    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" containerName="main"
Sep 11 16:18:48.457413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457400    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" containerName="main"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457417    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e8c4174-8f9a-44b9-bd51-eca54f040291" containerName="main"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457425    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e8c4174-8f9a-44b9-bd51-eca54f040291" containerName="main"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457535    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457548    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8373125-3a64-4970-a730-14778c642e7c" containerName="main"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457558    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdae0539-57ce-41bd-a2ff-c81a5de536f6" containerName="main"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457569    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:48.457961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.457579    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e8c4174-8f9a-44b9-bd51-eca54f040291" containerName="main"
Sep 11 16:18:48.462197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.462173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.466051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.466027    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-8a7a3a-openshift-default-dockercfg-v847n\""
Sep 11 16:18:48.510601 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.510564    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:18:48.530644 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.530612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:48.567669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zvz\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.567988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.568102 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.567989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.568102 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.568041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669249 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669249 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zvz\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.669889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.670016 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.669884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.670078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.670055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.670194 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.670167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.672174 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.672145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.672174 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.672163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.681087 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.681063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.682415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.682395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zvz\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz\") pod \"e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") " pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:48.769526 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.769483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:48.773433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:48.773412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:49.056725 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.056697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:18:49.057994 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:18:49.057967    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc0f61a_a283_4fc1_a065_cb9de4744157.slice/crio-ee58013efeed05e2274f9a0b62bb8c88b5808055817acb84bfe5c7f82aacf472 WatchSource:0}: Error finding container ee58013efeed05e2274f9a0b62bb8c88b5808055817acb84bfe5c7f82aacf472: Status 404 returned error can't find the container with id ee58013efeed05e2274f9a0b62bb8c88b5808055817acb84bfe5c7f82aacf472
Sep 11 16:18:49.060378 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.060347    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:49.060484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.060421    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:49.060484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.060464    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:18:49.743735 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.743701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerStarted","Data":"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"}
Sep 11 16:18:49.744235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.743763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerStarted","Data":"ee58013efeed05e2274f9a0b62bb8c88b5808055817acb84bfe5c7f82aacf472"}
Sep 11 16:18:49.773750 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.773718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:49.781767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:49.781721    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podStartSLOduration=1.78170469 podStartE2EDuration="1.78170469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:18:49.780705914 +0000 UTC m=+1000.042952069" watchObservedRunningTime="2026-09-11 16:18:49.78170469 +0000 UTC m=+1000.043950915"
Sep 11 16:18:50.778901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:50.778869    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:51.332583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:51.332537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:51.738396 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:51.738294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:51.756910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:51.756867    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:51.758250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:51.758227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:18:51.846636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:51.846605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:52.458576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:52.458506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:53.031844 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.031771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:18:53.109854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.109819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.109866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgz7k\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.109915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.109944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.109970    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110015    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token\") pod \"2715aa63-4d4d-424d-8b42-272c3d25c516\" (UID: \"2715aa63-4d4d-424d-8b42-272c3d25c516\") "
Sep 11 16:18:53.110353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:53.110612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110366    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:53.110612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110491    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.110612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110510    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.110612 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110583    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data" (OuterVolumeSpecName: "istio-data") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:53.110812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110682    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:53.110812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.110759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:53.112727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.112693    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:18:53.112840 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.112770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token" (OuterVolumeSpecName: "istio-token") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:53.112882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.112838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:18:53.112951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.112932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k" (OuterVolumeSpecName: "kube-api-access-pgz7k") pod "2715aa63-4d4d-424d-8b42-272c3d25c516" (UID: "2715aa63-4d4d-424d-8b42-272c3d25c516"). InnerVolumeSpecName "kube-api-access-pgz7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:53.211267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211225    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211255    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211268    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211556 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211307    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgz7k\" (UniqueName: \"kubernetes.io/projected/2715aa63-4d4d-424d-8b42-272c3d25c516-kube-api-access-pgz7k\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211556 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211323    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2715aa63-4d4d-424d-8b42-272c3d25c516-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211556 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211335    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2715aa63-4d4d-424d-8b42-272c3d25c516-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.211556 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.211347    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2715aa63-4d4d-424d-8b42-272c3d25c516-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:18:53.224977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.224941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:53.770322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.770286    2564 generic.go:356] "Generic (PLEG): container finished" podID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerID="d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797" exitCode=0
Sep 11 16:18:53.770536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.770340    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"
Sep 11 16:18:53.770536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.770365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerDied","Data":"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"}
Sep 11 16:18:53.770536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.770419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5" event={"ID":"2715aa63-4d4d-424d-8b42-272c3d25c516","Type":"ContainerDied","Data":"bf03627609c0bb2931aa9d8ab2cd145906cf712c1b0f70089773c6ba6b91454b"}
Sep 11 16:18:53.770536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.770441    2564 scope.go:117] "RemoveContainer" containerID="d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"
Sep 11 16:18:53.780457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.780442    2564 scope.go:117] "RemoveContainer" containerID="51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"
Sep 11 16:18:53.789916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.789895    2564 scope.go:117] "RemoveContainer" containerID="d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"
Sep 11 16:18:53.790226 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:18:53.790207    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797\": container with ID starting with d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797 not found: ID does not exist" containerID="d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"
Sep 11 16:18:53.790277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.790238    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797"} err="failed to get container status \"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797\": rpc error: code = NotFound desc = could not find container \"d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797\": container with ID starting with d201f37781f66a3c368727dcac9e9b36d10703a6e9065cd9453dc70624adf797 not found: ID does not exist"
Sep 11 16:18:53.790277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.790256    2564 scope.go:117] "RemoveContainer" containerID="51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"
Sep 11 16:18:53.790563 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:18:53.790545    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7\": container with ID starting with 51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7 not found: ID does not exist" containerID="51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"
Sep 11 16:18:53.790622 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.790569    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7"} err="failed to get container status \"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7\": rpc error: code = NotFound desc = could not find container \"51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7\": container with ID starting with 51d16ce76a29485235345abc6d7b867b2ea960e4d87d8a0f61b814d1f2d102a7 not found: ID does not exist"
Sep 11 16:18:53.796690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.796664    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:18:53.801630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:53.801609    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-e12be0-openshift-default-5b674995fb-mjxw5"]
Sep 11 16:18:54.016862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.016826    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:18:54.017198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.017186    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:18:54.017244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.017200    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:18:54.017244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.017212    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:54.017244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.017217    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b266202a-f895-4166-8bbd-61f114bbabc4" containerName="istio-proxy"
Sep 11 16:18:54.017345 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.017284    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:18:54.021706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.021647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.025715 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.025693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-8a7a3a-serving-cert\""
Sep 11 16:18:54.111010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.110966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:54.112851 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.112813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:18:54.121165 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.121132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.121335 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.121288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.121405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.121334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.121405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.121391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqmr6\" (UniqueName: \"kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.221927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.221892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.221927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.221930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.222196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.221959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqmr6\" (UniqueName: \"kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.222196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.221979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.222808 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.222703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.224606 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.224586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.224703 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.224620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.234190 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.234163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqmr6\" (UniqueName: \"kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6\") pod \"maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.266297 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.266253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:54.287615 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.287539    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" path="/var/lib/kubelet/pods/2715aa63-4d4d-424d-8b42-272c3d25c516/volumes"
Sep 11 16:18:54.333182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.333144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:54.611540 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.611498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:18:54.613021 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:18:54.612994    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04695f52_3427_458e_a69a_6be4f1925928.slice/crio-dc43b2f9f5e6c31ac9fd66069c1e7955b9b8c564156f5f0f13cf5ca59018c6a7 WatchSource:0}: Error finding container dc43b2f9f5e6c31ac9fd66069c1e7955b9b8c564156f5f0f13cf5ca59018c6a7: Status 404 returned error can't find the container with id dc43b2f9f5e6c31ac9fd66069c1e7955b9b8c564156f5f0f13cf5ca59018c6a7
Sep 11 16:18:54.614341 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.614321    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:18:54.684220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.684180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:54.778209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.778173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" event={"ID":"04695f52-3427-458e-a69a-6be4f1925928","Type":"ContainerStarted","Data":"dc43b2f9f5e6c31ac9fd66069c1e7955b9b8c564156f5f0f13cf5ca59018c6a7"}
Sep 11 16:18:54.826946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:54.826915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:18:55.786215 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:55.786171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" event={"ID":"04695f52-3427-458e-a69a-6be4f1925928","Type":"ContainerStarted","Data":"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"}
Sep 11 16:18:55.786616 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:55.786247    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:18:55.817985 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:18:55.817933    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" podStartSLOduration=2.502061371 podStartE2EDuration="2.817916996s" totalImagesPullingTime="315.855625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:18:55.81558427 +0000 UTC m=+1006.077830417" watchObservedRunningTime="2026-09-11 16:18:55.817916996 +0000 UTC m=+1006.080163139"
Sep 11 16:19:00.085416 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:00.085370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:00.687078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:00.687036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:19:01.553397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.553360    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:19:01.553823 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.553751    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:19:01.553823 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.553762    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:19:01.553903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.553833    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2715aa63-4d4d-424d-8b42-272c3d25c516" containerName="istio-proxy"
Sep 11 16:19:01.557168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.557147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.563484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.563455    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b6b139\"/\"test-model-b6b139-kserve-self-signed-certs\""
Sep 11 16:19:01.563659 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.563542    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b6b139\"/\"default-dockercfg-dccfq\""
Sep 11 16:19:01.563659 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.563633    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b6b139\"/\"kube-root-ca.crt\""
Sep 11 16:19:01.563775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.563655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b6b139\"/\"openshift-service-ca.crt\""
Sep 11 16:19:01.573830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.573804    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:19:01.710306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.710489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgfp\" (UniqueName: \"kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.710489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.710489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.710489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.710489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.710470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.801304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.801268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:19:01.811957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.811869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.811957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.811911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.811957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.811942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812236 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.811975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812236 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.812009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812236 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.812063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgfp\" (UniqueName: \"kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.812412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.812464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.812503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.812480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.814419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.814397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.814814 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.814795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.823993 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.823960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgfp\" (UniqueName: \"kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp\") pod \"test-model-b6b139-kserve-d559774dc-xq2hb\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") " pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.867437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.867404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:01.874574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:01.874536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:02.175535 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:02.175487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:19:02.829981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:02.829944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" event={"ID":"0e2674ad-e0ce-44ba-9928-fdee2c9c325c","Type":"ContainerStarted","Data":"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"}
Sep 11 16:19:02.829981 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:02.829989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" event={"ID":"0e2674ad-e0ce-44ba-9928-fdee2c9c325c","Type":"ContainerStarted","Data":"86eba2a800ac7d0c300f280a7076bcb36cb174d46b758cc9bd1c30b9af945aa4"}
Sep 11 16:19:02.851700 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:02.851644    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" podStartSLOduration=1.851623163 podStartE2EDuration="1.851623163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:19:02.850842149 +0000 UTC m=+1013.113088292" watchObservedRunningTime="2026-09-11 16:19:02.851623163 +0000 UTC m=+1013.113869304"
Sep 11 16:19:07.116513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:07.116469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:07.221459 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:07.221416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:07.326532 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:07.326474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:10.881670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.881639    2564 generic.go:356] "Generic (PLEG): container finished" podID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerID="4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84" exitCode=0
Sep 11 16:19:10.882257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.881718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerDied","Data":"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"}
Sep 11 16:19:10.882324 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.882302    2564 scope.go:117] "RemoveContainer" containerID="4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"
Sep 11 16:19:10.883574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.883541    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:19:10.883655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.883630    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:19:10.883696 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:10.883684    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:19:11.868485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:11.868448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:11.868687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:11.868497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:11.898284 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:11.898249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerStarted","Data":"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"}
Sep 11 16:19:11.908095 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:11.908063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:11.919447 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:11.919423    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:19:12.774035 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:12.773997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:19:12.774333 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:12.774308    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 16:19:12.774402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:12.774382    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 16:19:13.774234 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:13.774200    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 16:19:13.774639 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:13.774262    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 16:19:14.774806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:14.774766    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 16:19:14.775207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:14.774833    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 16:19:15.774828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:15.774791    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 16:19:15.775210 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:15.774858    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 16:19:16.643239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:16.643203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:16.774651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:16.774615    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 16:19:16.774822 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:16.774686    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 16:19:16.856510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:16.856470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:17.778022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:17.777989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:19:17.778272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:17.778252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:19:17.779058 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:17.779043    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:19:18.069563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:18.069458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:18.214359 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:18.214326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:19:19.355820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:19.355784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:20.438695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:20.438660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:22.220321 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.220286    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:22.224066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.224048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.228319 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.228296    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-8a7a3a\"/\"openshift-service-ca.crt\""
Sep 11 16:19:22.228440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.228299    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-8a7a3a\"/\"kube-root-ca.crt\""
Sep 11 16:19:22.229371 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.229350    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-8a7a3a\"/\"default-dockercfg-mdg8r\""
Sep 11 16:19:22.229565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.229546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-8a7a3a\"/\"explicit-model-8a7a3a-kserve-self-signed-certs\""
Sep 11 16:19:22.250312 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.250275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:22.260439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.260362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:22.305449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.305449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.305683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbn8\" (UniqueName: \"kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.305683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.305683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.305789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.305714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.406719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.406898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.406898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbn8\" (UniqueName: \"kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.406898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.407058 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.407058 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.406979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.407202 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.407163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.407422 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.407391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.407547 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.407463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.409408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.409386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.409584 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.409565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.416645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.416624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbn8\" (UniqueName: \"kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8\") pod \"explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") " pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.534179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.534141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:22.823003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.822969    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:22.824085 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:19:22.824060    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0583bf6e_052d_462c_8138_ab1ed6de4476.slice/crio-4dbe448743f8606ce2d6ae00a641c6ead7e5da0d775197000564cfc4e2fe1f10 WatchSource:0}: Error finding container 4dbe448743f8606ce2d6ae00a641c6ead7e5da0d775197000564cfc4e2fe1f10: Status 404 returned error can't find the container with id 4dbe448743f8606ce2d6ae00a641c6ead7e5da0d775197000564cfc4e2fe1f10
Sep 11 16:19:22.964677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.964637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" event={"ID":"0583bf6e-052d-462c-8138-ab1ed6de4476","Type":"ContainerStarted","Data":"15a1cd7fbe5f0d6deb9bfdfd8a25123df54502a89d30da73e2ee4cc170822427"}
Sep 11 16:19:22.964848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:22.964688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" event={"ID":"0583bf6e-052d-462c-8138-ab1ed6de4476","Type":"ContainerStarted","Data":"4dbe448743f8606ce2d6ae00a641c6ead7e5da0d775197000564cfc4e2fe1f10"}
Sep 11 16:19:23.006353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:23.006294    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" podStartSLOduration=1.006274011 podStartE2EDuration="1.006274011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:19:23.005453105 +0000 UTC m=+1033.267699249" watchObservedRunningTime="2026-09-11 16:19:23.006274011 +0000 UTC m=+1033.268520153"
Sep 11 16:19:23.224837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:23.224749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:29.581898 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:29.581861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:19:29.944385 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:29.944287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:30.087718 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:30.087679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:30.207696 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:30.207614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:32.534711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:32.534655    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:32.534711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:32.534729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:32.547593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:32.547565    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:33.032411 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:33.032378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:40.736421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:40.736384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:41.486028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:41.485996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:42.028159 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:42.028120    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:42.061076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:42.061046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:43.038624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:43.038588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:43.828885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:43.828845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:43.880792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:43.880757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:19:44.774708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:44.774671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:45.798908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:45.798867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:48.775959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:48.775920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:48.878125 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:48.878085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:49.076940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:49.076850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:49.177043 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:49.177011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:49.796450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:49.796418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:49.907078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:49.907044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:51.383017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:51.382981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:52.638912 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.638877    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:19:52.639316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.639090    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" podUID="04695f52-3427-458e-a69a-6be4f1925928" containerName="maas-api" containerID="cri-o://8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56" gracePeriod=30
Sep 11 16:19:52.673774 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.673742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:52.757228 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.757190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:52.838391 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.838353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:52.896028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.895962    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:19:52.933148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:52.933111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:53.013251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.013217    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqmr6\" (UniqueName: \"kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6\") pod \"04695f52-3427-458e-a69a-6be4f1925928\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") "
Sep 11 16:19:53.013460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.013268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs\") pod \"04695f52-3427-458e-a69a-6be4f1925928\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") "
Sep 11 16:19:53.013460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.013330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca\") pod \"04695f52-3427-458e-a69a-6be4f1925928\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") "
Sep 11 16:19:53.013460 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.013385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls\") pod \"04695f52-3427-458e-a69a-6be4f1925928\" (UID: \"04695f52-3427-458e-a69a-6be4f1925928\") "
Sep 11 16:19:53.013740 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.013704    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04695f52-3427-458e-a69a-6be4f1925928" (UID: "04695f52-3427-458e-a69a-6be4f1925928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:19:53.015651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.015622    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04695f52-3427-458e-a69a-6be4f1925928" (UID: "04695f52-3427-458e-a69a-6be4f1925928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:19:53.015759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.015698    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6" (OuterVolumeSpecName: "kube-api-access-wqmr6") pod "04695f52-3427-458e-a69a-6be4f1925928" (UID: "04695f52-3427-458e-a69a-6be4f1925928"). InnerVolumeSpecName "kube-api-access-wqmr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:19:53.015759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.015705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04695f52-3427-458e-a69a-6be4f1925928" (UID: "04695f52-3427-458e-a69a-6be4f1925928"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:19:53.028885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.028809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:53.115141 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.115101    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqmr6\" (UniqueName: \"kubernetes.io/projected/04695f52-3427-458e-a69a-6be4f1925928-kube-api-access-wqmr6\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:53.115141 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.115137    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:53.115375 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.115152    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04695f52-3427-458e-a69a-6be4f1925928-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:53.115375 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.115165    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04695f52-3427-458e-a69a-6be4f1925928-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:53.136683 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.136649    2564 generic.go:356] "Generic (PLEG): container finished" podID="04695f52-3427-458e-a69a-6be4f1925928" containerID="8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56" exitCode=0
Sep 11 16:19:53.136853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.136697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"
Sep 11 16:19:53.136853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.136734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" event={"ID":"04695f52-3427-458e-a69a-6be4f1925928","Type":"ContainerDied","Data":"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"}
Sep 11 16:19:53.136853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.136785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z" event={"ID":"04695f52-3427-458e-a69a-6be4f1925928","Type":"ContainerDied","Data":"dc43b2f9f5e6c31ac9fd66069c1e7955b9b8c564156f5f0f13cf5ca59018c6a7"}
Sep 11 16:19:53.136853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.136808    2564 scope.go:117] "RemoveContainer" containerID="8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"
Sep 11 16:19:53.147404 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.147385    2564 scope.go:117] "RemoveContainer" containerID="8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"
Sep 11 16:19:53.147786 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:19:53.147765    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56\": container with ID starting with 8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56 not found: ID does not exist" containerID="8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"
Sep 11 16:19:53.147876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.147797    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56"} err="failed to get container status \"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56\": rpc error: code = NotFound desc = could not find container \"8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56\": container with ID starting with 8aaaff9543cdb2313f5bcaf611808f0e8a5abf8f9cb77af7f272fc6b0528cf56 not found: ID does not exist"
Sep 11 16:19:53.160343 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.160312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:19:53.162708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.162687    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-8a7a3a-5bd6c5b567-j9r4z"]
Sep 11 16:19:53.241868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.241838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:53.469219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:53.469125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:54.287153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:54.287115    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04695f52-3427-458e-a69a-6be4f1925928" path="/var/lib/kubelet/pods/04695f52-3427-458e-a69a-6be4f1925928/volumes"
Sep 11 16:19:54.358457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:54.358425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:55.261860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:55.261818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:57.047936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.047892    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" podUID="0583bf6e-052d-462c-8138-ab1ed6de4476" containerName="main" containerID="cri-o://15a1cd7fbe5f0d6deb9bfdfd8a25123df54502a89d30da73e2ee4cc170822427" gracePeriod=45
Sep 11 16:19:57.162868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.162839    2564 generic.go:356] "Generic (PLEG): container finished" podID="0583bf6e-052d-462c-8138-ab1ed6de4476" containerID="15a1cd7fbe5f0d6deb9bfdfd8a25123df54502a89d30da73e2ee4cc170822427" exitCode=0
Sep 11 16:19:57.162996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.162905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" event={"ID":"0583bf6e-052d-462c-8138-ab1ed6de4476","Type":"ContainerDied","Data":"15a1cd7fbe5f0d6deb9bfdfd8a25123df54502a89d30da73e2ee4cc170822427"}
Sep 11 16:19:57.295432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.295409    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:57.356766 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.356688    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmbn8\" (UniqueName: \"kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.356914 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.356805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.356914 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.356899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.357000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.356967    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.357050 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357013    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.357091 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357051    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home" (OuterVolumeSpecName: "home") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:19:57.357138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm\") pod \"0583bf6e-052d-462c-8138-ab1ed6de4476\" (UID: \"0583bf6e-052d-462c-8138-ab1ed6de4476\") "
Sep 11 16:19:57.357190 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357137    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache" (OuterVolumeSpecName: "model-cache") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:19:57.357252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357228    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:19:57.357580 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357558    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:57.357767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357742    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:57.357867 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.357770    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:57.359258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.359237    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8" (OuterVolumeSpecName: "kube-api-access-fmbn8") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "kube-api-access-fmbn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:19:57.359847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.359820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm" (OuterVolumeSpecName: "dshm") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:19:57.359904 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.359825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0583bf6e-052d-462c-8138-ab1ed6de4476" (UID: "0583bf6e-052d-462c-8138-ab1ed6de4476"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:19:57.458910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.458873    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmbn8\" (UniqueName: \"kubernetes.io/projected/0583bf6e-052d-462c-8138-ab1ed6de4476-kube-api-access-fmbn8\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:57.458910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.458902    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0583bf6e-052d-462c-8138-ab1ed6de4476-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:57.458910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:57.458914    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0583bf6e-052d-462c-8138-ab1ed6de4476-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:19:58.169987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.169951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k" event={"ID":"0583bf6e-052d-462c-8138-ab1ed6de4476","Type":"ContainerDied","Data":"4dbe448743f8606ce2d6ae00a641c6ead7e5da0d775197000564cfc4e2fe1f10"}
Sep 11 16:19:58.169987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.169981    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"
Sep 11 16:19:58.170511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.170004    2564 scope.go:117] "RemoveContainer" containerID="15a1cd7fbe5f0d6deb9bfdfd8a25123df54502a89d30da73e2ee4cc170822427"
Sep 11 16:19:58.196639 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.196614    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:58.201239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.201214    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-8a7a3a/explicit-model-8a7a3a-kserve-5d8ffb8799-bxb4k"]
Sep 11 16:19:58.287066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:58.287033    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0583bf6e-052d-462c-8138-ab1ed6de4476" path="/var/lib/kubelet/pods/0583bf6e-052d-462c-8138-ab1ed6de4476/volumes"
Sep 11 16:19:59.457373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:59.457331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:59.547693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:59.547654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:59.889069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:59.889043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:19:59.987687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:19:59.987653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:00.121945 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.121910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:00.134857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.134824    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:20:00.135060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.135034    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" containerID="cri-o://23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0" gracePeriod=30
Sep 11 16:20:00.198988 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.198874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:00.565884 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.565852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:00.829173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829055    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:00.829541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829497    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04695f52-3427-458e-a69a-6be4f1925928" containerName="maas-api"
Sep 11 16:20:00.829619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829548    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="04695f52-3427-458e-a69a-6be4f1925928" containerName="maas-api"
Sep 11 16:20:00.829619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829564    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0583bf6e-052d-462c-8138-ab1ed6de4476" containerName="main"
Sep 11 16:20:00.829619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829570    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0583bf6e-052d-462c-8138-ab1ed6de4476" containerName="main"
Sep 11 16:20:00.829787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829647    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0583bf6e-052d-462c-8138-ab1ed6de4476" containerName="main"
Sep 11 16:20:00.829787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.829665    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="04695f52-3427-458e-a69a-6be4f1925928" containerName="maas-api"
Sep 11 16:20:00.834200 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.834178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.837812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.837793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-468f25-openshift-default-dockercfg-9wwfb\""
Sep 11 16:20:00.852603 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.852576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:00.890214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6kd\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.890773 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.890577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.958859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.958823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:00.991967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.991937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6kd\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992799 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.992884 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.992784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.993155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.993131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.993287 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.993265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.994631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.994609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:00.994842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:00.994826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:01.007762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.007728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:01.008180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.008163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6kd\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd\") pod \"e2e-noten-468f25-openshift-default-dffb8969d-65dnb\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") " pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:01.118717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.118626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:01.147670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.147637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:01.432564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.430057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:01.434928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.434873    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:01.435054 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.435022    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:01.435168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:01.435148    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:02.197121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.197077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" event={"ID":"745d1687-1189-472e-bdc4-be348cd8e6f0","Type":"ContainerStarted","Data":"3418053e09ec09e3bdfdcb4cad5b5297abae2d2719b70b3db5bf2b41f2d4a62a"}
Sep 11 16:20:02.197647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.197141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" event={"ID":"745d1687-1189-472e-bdc4-be348cd8e6f0","Type":"ContainerStarted","Data":"a5c0d35f13859589ec002d15d8c63c982e91b9cb8a698a73d137c7c4575ae742"}
Sep 11 16:20:02.221044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.220984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" podStartSLOduration=2.220964427 podStartE2EDuration="2.220964427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:20:02.219509994 +0000 UTC m=+1072.481756164" watchObservedRunningTime="2026-09-11 16:20:02.220964427 +0000 UTC m=+1072.483210628"
Sep 11 16:20:02.507667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.507634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:02.603258 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.603224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:02.781309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.781218    2564 patch_prober.go:28] interesting pod/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:20:02.781452 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.781303    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:20:02.833698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:02.833664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:03.148679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:03.148586    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:03.154685 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:03.154658    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:03.202883 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:03.202845    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:03.204039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:03.204017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:03.864775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:03.864736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:20:05.395199 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.395171    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:20:05.539286 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539308    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539350    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539447    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99zvz\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:05.539687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539717    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy\") pod \"6dc0f61a-a283-4fc1-a065-cb9de4744157\" (UID: \"6dc0f61a-a283-4fc1-a065-cb9de4744157\") "
Sep 11 16:20:05.539967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:05.539967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.539827    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:05.540157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.540040    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:05.540157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.540088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:05.540157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.540106    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc0f61a-a283-4fc1-a065-cb9de4744157-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.540278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.540157    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.540278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.540172    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.541931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.541908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:20:05.542029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.541965    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:05.542282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.542265    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz" (OuterVolumeSpecName: "kube-api-access-99zvz") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "kube-api-access-99zvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:05.542352 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.542310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dc0f61a-a283-4fc1-a065-cb9de4744157" (UID: "6dc0f61a-a283-4fc1-a065-cb9de4744157"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:05.641765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641714    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.641765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641758    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.641765 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641771    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99zvz\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-kube-api-access-99zvz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.642015 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641784    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.642015 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641798    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:05.642015 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:05.641808    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc0f61a-a283-4fc1-a065-cb9de4744157-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:06.222442 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.222403    2564 generic.go:356] "Generic (PLEG): container finished" podID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerID="23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0" exitCode=0
Sep 11 16:20:06.222670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.222466    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"
Sep 11 16:20:06.222670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.222499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerDied","Data":"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"}
Sep 11 16:20:06.222670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.222588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd" event={"ID":"6dc0f61a-a283-4fc1-a065-cb9de4744157","Type":"ContainerDied","Data":"ee58013efeed05e2274f9a0b62bb8c88b5808055817acb84bfe5c7f82aacf472"}
Sep 11 16:20:06.222670 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.222617    2564 scope.go:117] "RemoveContainer" containerID="23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"
Sep 11 16:20:06.234927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.234898    2564 scope.go:117] "RemoveContainer" containerID="4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"
Sep 11 16:20:06.245277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.245254    2564 scope.go:117] "RemoveContainer" containerID="23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"
Sep 11 16:20:06.245635 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:20:06.245610    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0\": container with ID starting with 23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0 not found: ID does not exist" containerID="23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"
Sep 11 16:20:06.245746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.245641    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0"} err="failed to get container status \"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0\": rpc error: code = NotFound desc = could not find container \"23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0\": container with ID starting with 23790936ce30960390edf95f1948b9815955e032f7a211190852aa37f653d6b0 not found: ID does not exist"
Sep 11 16:20:06.245746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.245659    2564 scope.go:117] "RemoveContainer" containerID="4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"
Sep 11 16:20:06.245885 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:20:06.245871    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84\": container with ID starting with 4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84 not found: ID does not exist" containerID="4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"
Sep 11 16:20:06.245924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.245890    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84"} err="failed to get container status \"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84\": rpc error: code = NotFound desc = could not find container \"4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84\": container with ID starting with 4fb6be82b637c45ac490a490d316fd36953b1a75af73b53b2910a601a427fe84 not found: ID does not exist"
Sep 11 16:20:06.254277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.254249    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:20:06.258814 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.258789    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-8a7a3a-openshift-default-5bf96d79c6-8lkcd"]
Sep 11 16:20:06.287231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.287191    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" path="/var/lib/kubelet/pods/6dc0f61a-a283-4fc1-a065-cb9de4744157/volumes"
Sep 11 16:20:06.835478 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.835428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:06.935684 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:06.935647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:07.039574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.039506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:07.333905 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.333875    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:20:07.334260 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.334247    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:07.334260 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.334261    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:07.334420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.334270    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:07.334420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.334275    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:07.334420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.334367    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:07.338852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.338831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.342494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.342475    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3882e47c-openshift-default-dockercfg-xqp9f\""
Sep 11 16:20:07.362775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.362735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:20:07.375069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.375034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:07.458568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkp5v\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.458873 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.459022 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.458919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkp5v\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.560860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.561068 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.560870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.561129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.561112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.561251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.561230    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.562982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.562954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.563102 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.563086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.580304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.580277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.620193 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.620103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkp5v\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v\") pod \"e2e-mt-3882e47c-openshift-default-666747d56-9pv9q\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") " pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.649609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.649579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:07.711541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.711434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:07.944600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.944576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:20:07.946323 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:20:07.946293    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756a4aa4_3fb7_4510_895a_e2cb636d3d14.slice/crio-d28c6f43be47eed9b8477fecf9013070887ebad954a36f5537419d1754ed5df7 WatchSource:0}: Error finding container d28c6f43be47eed9b8477fecf9013070887ebad954a36f5537419d1754ed5df7: Status 404 returned error can't find the container with id d28c6f43be47eed9b8477fecf9013070887ebad954a36f5537419d1754ed5df7
Sep 11 16:20:07.948646 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.948618    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:07.948728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.948685    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:07.948728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:07.948712    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:08.236549 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:08.236449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerStarted","Data":"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"}
Sep 11 16:20:08.236549 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:08.236508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerStarted","Data":"d28c6f43be47eed9b8477fecf9013070887ebad954a36f5537419d1754ed5df7"}
Sep 11 16:20:08.296137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:08.296075    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podStartSLOduration=1.296060397 podStartE2EDuration="1.296060397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:20:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:20:08.295003889 +0000 UTC m=+1078.557250030" watchObservedRunningTime="2026-09-11 16:20:08.296060397 +0000 UTC m=+1078.558306540"
Sep 11 16:20:08.650407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:08.650370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:09.655513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:09.655479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:10.255878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:10.255844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:10.256969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:10.256945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:10.468263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:10.468225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:10.712774 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:10.712739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:11.197568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:11.197533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:12.393781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.393750    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:12.394203 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.394194    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc0f61a-a283-4fc1-a065-cb9de4744157" containerName="istio-proxy"
Sep 11 16:20:12.398701 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.398681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.406342 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.406320    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-468f25\"/\"default-dockercfg-m872h\""
Sep 11 16:20:12.406502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.406473    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-468f25\"/\"noten-model-468f25-kserve-self-signed-certs\""
Sep 11 16:20:12.406662 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.406575    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-468f25\"/\"openshift-service-ca.crt\""
Sep 11 16:20:12.406822 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.406803    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-468f25\"/\"kube-root-ca.crt\""
Sep 11 16:20:12.426552 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.426510    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:12.497602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.497567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:12.506751 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.506722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.506906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.506756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.506906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.506842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bpc\" (UniqueName: \"kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.506906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.506868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.506906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.506906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.507046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.507016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608058 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bpc\" (UniqueName: \"kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608058 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.608707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.608678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.610775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.610751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.610997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.610980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.629267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.629233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bpc\" (UniqueName: \"kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc\") pod \"noten-model-468f25-kserve-55f9f46895-6hbf9\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") " pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:12.671598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.671450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:12.708273 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:12.708233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:13.054592 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:13.054565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:13.054718 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:20:13.054687    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f804670_5e23_412a_886c_59de978107f7.slice/crio-d0330eb83f3bf7c54fb61c6b8c09364ff12a31368c926410a5700143d76d1125 WatchSource:0}: Error finding container d0330eb83f3bf7c54fb61c6b8c09364ff12a31368c926410a5700143d76d1125: Status 404 returned error can't find the container with id d0330eb83f3bf7c54fb61c6b8c09364ff12a31368c926410a5700143d76d1125
Sep 11 16:20:13.275449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:13.275412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" event={"ID":"0f804670-5e23-412a-886c-59de978107f7","Type":"ContainerStarted","Data":"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"}
Sep 11 16:20:13.275654 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:13.275466    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" event={"ID":"0f804670-5e23-412a-886c-59de978107f7","Type":"ContainerStarted","Data":"d0330eb83f3bf7c54fb61c6b8c09364ff12a31368c926410a5700143d76d1125"}
Sep 11 16:20:13.313473 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:13.313368    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" podStartSLOduration=1.313350478 podStartE2EDuration="1.313350478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:20:13.306793972 +0000 UTC m=+1083.569040114" watchObservedRunningTime="2026-09-11 16:20:13.313350478 +0000 UTC m=+1083.575596621"
Sep 11 16:20:14.260390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:14.260345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:14.389679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:14.389642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:14.521757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:14.521666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:15.106864 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:15.106829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:15.258275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:15.258240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:17.786498 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:17.786440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:21.348538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:21.348489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:20:22.085447 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.085412    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:22.164218 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.164181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:22.207104 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.207070    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:22.207298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.207278    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" podUID="745d1687-1189-472e-bdc4-be348cd8e6f0" containerName="istio-proxy" containerID="cri-o://3418053e09ec09e3bdfdcb4cad5b5297abae2d2719b70b3db5bf2b41f2d4a62a" gracePeriod=30
Sep 11 16:20:22.339295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.339199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:22.460745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.460711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:22.607053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.606934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:22.709067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:22.709031    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:23.806762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:23.806730    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:20:23.839289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:23.839260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:24.328781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:24.328733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:25.553627 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:25.553594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:26.606279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:26.606241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:27.361595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.361561    2564 generic.go:356] "Generic (PLEG): container finished" podID="745d1687-1189-472e-bdc4-be348cd8e6f0" containerID="3418053e09ec09e3bdfdcb4cad5b5297abae2d2719b70b3db5bf2b41f2d4a62a" exitCode=0
Sep 11 16:20:27.361766 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.361627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" event={"ID":"745d1687-1189-472e-bdc4-be348cd8e6f0","Type":"ContainerDied","Data":"3418053e09ec09e3bdfdcb4cad5b5297abae2d2719b70b3db5bf2b41f2d4a62a"}
Sep 11 16:20:27.509316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.509284    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:27.552528 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552484    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp6kd\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552558    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552730    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552809    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:27.552989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552847    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket\") pod \"745d1687-1189-472e-bdc4-be348cd8e6f0\" (UID: \"745d1687-1189-472e-bdc4-be348cd8e6f0\") "
Sep 11 16:20:27.552989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.552939    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:27.553265 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.553154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:27.553265 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.553214    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.553265 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.553233    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.553712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.553454    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:27.553827 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.553732    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:27.555176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.555144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:20:27.555176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.555164    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:27.555370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.555240    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:27.555370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.555335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd" (OuterVolumeSpecName: "kube-api-access-rp6kd") pod "745d1687-1189-472e-bdc4-be348cd8e6f0" (UID: "745d1687-1189-472e-bdc4-be348cd8e6f0"). InnerVolumeSpecName "kube-api-access-rp6kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:27.654067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654031    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654062    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654073    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654085    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745d1687-1189-472e-bdc4-be348cd8e6f0-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654097    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp6kd\" (UniqueName: \"kubernetes.io/projected/745d1687-1189-472e-bdc4-be348cd8e6f0-kube-api-access-rp6kd\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654110    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745d1687-1189-472e-bdc4-be348cd8e6f0-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.654505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.654121    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745d1687-1189-472e-bdc4-be348cd8e6f0-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:27.724329 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:27.724243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:28.015322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.015281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:28.368505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.368475    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"
Sep 11 16:20:28.368505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.368496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb" event={"ID":"745d1687-1189-472e-bdc4-be348cd8e6f0","Type":"ContainerDied","Data":"a5c0d35f13859589ec002d15d8c63c982e91b9cb8a698a73d137c7c4575ae742"}
Sep 11 16:20:28.368748 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.368576    2564 scope.go:117] "RemoveContainer" containerID="3418053e09ec09e3bdfdcb4cad5b5297abae2d2719b70b3db5bf2b41f2d4a62a"
Sep 11 16:20:28.406843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.406808    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:28.415617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:28.415589    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-468f25-openshift-default-dffb8969d-65dnb"]
Sep 11 16:20:29.181658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:29.181623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:30.195690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:30.195638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:30.286529 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:30.286491    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745d1687-1189-472e-bdc4-be348cd8e6f0" path="/var/lib/kubelet/pods/745d1687-1189-472e-bdc4-be348cd8e6f0/volumes"
Sep 11 16:20:30.376382 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:30.376347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:30.868162 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:30.868110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:30.984069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:30.984017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:31.380983 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:31.380928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:31.614753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:31.614716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:32.394613 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.394579    2564 generic.go:356] "Generic (PLEG): container finished" podID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerID="885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf" exitCode=0
Sep 11 16:20:32.395005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.394651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerDied","Data":"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"}
Sep 11 16:20:32.395112 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.395097    2564 scope.go:117] "RemoveContainer" containerID="885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"
Sep 11 16:20:32.396307 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.396271    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:32.396415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.396342    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:32.396415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:32.396373    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:20:33.166116 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:33.166076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:20:33.405742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:33.405712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerStarted","Data":"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"}
Sep 11 16:20:33.650255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:33.650216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:33.650574 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:33.650552    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:33.650635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:33.650601    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:34.053979 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.053942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:34.650512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.650474    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:34.650976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.650565    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:34.763053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.763015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:34.858942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.858902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:34.957251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:34.957150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:35.060790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:35.060759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:35.351661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:35.351626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:35.482183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:35.482145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:35.650217 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:35.650126    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:35.650217 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:35.650178    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:36.355678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:36.355645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:36.650340 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:36.650236    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:36.650340 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:36.650305    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:37.106279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.106234    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" podUID="0f804670-5e23-412a-886c-59de978107f7" containerName="main" containerID="cri-o://ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4" gracePeriod=45
Sep 11 16:20:37.258885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.258852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:37.362201 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.362128    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:37.429350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.429316    2564 generic.go:356] "Generic (PLEG): container finished" podID="0f804670-5e23-412a-886c-59de978107f7" containerID="ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4" exitCode=0
Sep 11 16:20:37.429572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.429358    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"
Sep 11 16:20:37.429572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.429407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" event={"ID":"0f804670-5e23-412a-886c-59de978107f7","Type":"ContainerDied","Data":"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"}
Sep 11 16:20:37.429572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.429453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9" event={"ID":"0f804670-5e23-412a-886c-59de978107f7","Type":"ContainerDied","Data":"d0330eb83f3bf7c54fb61c6b8c09364ff12a31368c926410a5700143d76d1125"}
Sep 11 16:20:37.429572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.429477    2564 scope.go:117] "RemoveContainer" containerID="ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"
Sep 11 16:20:37.439117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.439099    2564 scope.go:117] "RemoveContainer" containerID="ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"
Sep 11 16:20:37.439421 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:20:37.439401    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4\": container with ID starting with ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4 not found: ID does not exist" containerID="ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"
Sep 11 16:20:37.439546 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.439430    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4"} err="failed to get container status \"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4\": rpc error: code = NotFound desc = could not find container \"ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4\": container with ID starting with ea12a4154d46ea21aed4fa54177220429e87165ff2298b1e50db183e21c17bf4 not found: ID does not exist"
Sep 11 16:20:37.452780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.452889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452800    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.452889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452840    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.452889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452867    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9bpc\" (UniqueName: \"kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.453055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.453055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.452930    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm\") pod \"0f804670-5e23-412a-886c-59de978107f7\" (UID: \"0f804670-5e23-412a-886c-59de978107f7\") "
Sep 11 16:20:37.453055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453030    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:37.453209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453145    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:37.453209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home" (OuterVolumeSpecName: "home") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:37.453304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453292    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.453353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453338    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.453394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.453352    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.455137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.455114    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:20:37.455137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.455119    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc" (OuterVolumeSpecName: "kube-api-access-d9bpc") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "kube-api-access-d9bpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:37.455277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.455142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm" (OuterVolumeSpecName: "dshm") pod "0f804670-5e23-412a-886c-59de978107f7" (UID: "0f804670-5e23-412a-886c-59de978107f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:37.554139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.554092    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9bpc\" (UniqueName: \"kubernetes.io/projected/0f804670-5e23-412a-886c-59de978107f7-kube-api-access-d9bpc\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.554139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.554132    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f804670-5e23-412a-886c-59de978107f7-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.554139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.554146    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f804670-5e23-412a-886c-59de978107f7-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:37.650761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.650673    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:37.650761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.650744    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:37.755877 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.755845    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:37.758971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:37.758939    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-468f25/noten-model-468f25-kserve-55f9f46895-6hbf9"]
Sep 11 16:20:38.254432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.254389    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:38.304919 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.304881    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f804670-5e23-412a-886c-59de978107f7" path="/var/lib/kubelet/pods/0f804670-5e23-412a-886c-59de978107f7/volumes"
Sep 11 16:20:38.357113 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.357081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:38.650739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.650702    2564 patch_prober.go:28] interesting pod/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 16:20:38.651151 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.650762    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 16:20:38.826944 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:38.826898    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" podUID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" containerName="main" containerID="cri-o://2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc" gracePeriod=45
Sep 11 16:20:39.074760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.074736    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:20:39.157317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.157286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:39.169995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.169966    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170056    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170107    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgfp\" (UniqueName: \"kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170135    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170194    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm\") pod \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\" (UID: \"0e2674ad-e0ce-44ba-9928-fdee2c9c325c\") "
Sep 11 16:20:39.170425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:39.170425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170352    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home" (OuterVolumeSpecName: "home") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:39.170425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:39.170628 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170590    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.170628 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170609    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.170628 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.170623    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.172635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.172607    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm" (OuterVolumeSpecName: "dshm") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:39.172635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.172604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:20:39.173250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.173226    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp" (OuterVolumeSpecName: "kube-api-access-srgfp") pod "0e2674ad-e0ce-44ba-9928-fdee2c9c325c" (UID: "0e2674ad-e0ce-44ba-9928-fdee2c9c325c"). InnerVolumeSpecName "kube-api-access-srgfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:39.271812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.271782    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgfp\" (UniqueName: \"kubernetes.io/projected/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-kube-api-access-srgfp\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.271812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.271812    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.272030 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.271822    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e2674ad-e0ce-44ba-9928-fdee2c9c325c-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:39.443225 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.443189    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" containerID="2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc" exitCode=0
Sep 11 16:20:39.443420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.443242    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"
Sep 11 16:20:39.443420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.443276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" event={"ID":"0e2674ad-e0ce-44ba-9928-fdee2c9c325c","Type":"ContainerDied","Data":"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"}
Sep 11 16:20:39.443420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.443320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb" event={"ID":"0e2674ad-e0ce-44ba-9928-fdee2c9c325c","Type":"ContainerDied","Data":"86eba2a800ac7d0c300f280a7076bcb36cb174d46b758cc9bd1c30b9af945aa4"}
Sep 11 16:20:39.443420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.443337    2564 scope.go:117] "RemoveContainer" containerID="2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"
Sep 11 16:20:39.453143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.453125    2564 scope.go:117] "RemoveContainer" containerID="2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"
Sep 11 16:20:39.453423 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:20:39.453405    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc\": container with ID starting with 2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc not found: ID does not exist" containerID="2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"
Sep 11 16:20:39.453475 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.453431    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc"} err="failed to get container status \"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc\": rpc error: code = NotFound desc = could not find container \"2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc\": container with ID starting with 2eccb0ab85efa9d77acac29184c92c35f620c23bf1bbf26148f823e1c3b0b1cc not found: ID does not exist"
Sep 11 16:20:39.471605 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.471572    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:20:39.477703 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.477670    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b6b139/test-model-b6b139-kserve-d559774dc-xq2hb"]
Sep 11 16:20:39.655168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.655092    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:39.655544 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.655365    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:39.655979 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:39.655964    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:20:40.053807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:40.053777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:40.292739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:40.292702    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" path="/var/lib/kubelet/pods/0e2674ad-e0ce-44ba-9928-fdee2c9c325c/volumes"
Sep 11 16:20:40.849795 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:40.849759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:41.747995 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:41.747963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:42.266501 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:42.266466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:42.370250 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:42.370216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:42.393514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:42.393478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:20:42.545889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:42.545791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:42.970739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:42.970621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:43.896742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:43.896708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:44.852314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:44.852279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:45.759843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:45.759785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:52.157248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:52.157212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.030541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.030480    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:20:53.030767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.030744    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" podUID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" containerName="maas-api" containerID="cri-o://7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e" gracePeriod=30
Sep 11 16:20:53.100184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.100151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.197415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.197383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.296830 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.296762    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:20:53.300447 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.300420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.388713 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.388683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.411934 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.411905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs\") pod \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") "
Sep 11 16:20:53.412137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.412017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckhf\" (UniqueName: \"kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf\") pod \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") "
Sep 11 16:20:53.412137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.412055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls\") pod \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") "
Sep 11 16:20:53.412137 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.412127    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca\") pod \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\" (UID: \"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3\") "
Sep 11 16:20:53.412604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.412506    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" (UID: "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:53.414370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.414346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" (UID: "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:20:53.414482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.414426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" (UID: "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:20:53.414651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.414635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf" (OuterVolumeSpecName: "kube-api-access-8ckhf") pod "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" (UID: "d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3"). InnerVolumeSpecName "kube-api-access-8ckhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:53.513997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.513964    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckhf\" (UniqueName: \"kubernetes.io/projected/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-kube-api-access-8ckhf\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.513997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.513997    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.513997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.514010    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.514269 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.514022    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.529454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.529424    2564 generic.go:356] "Generic (PLEG): container finished" podID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" containerID="7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e" exitCode=0
Sep 11 16:20:53.529638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.529475    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"
Sep 11 16:20:53.529638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.529538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" event={"ID":"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3","Type":"ContainerDied","Data":"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"}
Sep 11 16:20:53.529638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.529589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q" event={"ID":"d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3","Type":"ContainerDied","Data":"97cec84a9aec8bf90455995fb2ebe44ab2e7268067a532c70cf7a523328a8e8d"}
Sep 11 16:20:53.529638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.529610    2564 scope.go:117] "RemoveContainer" containerID="7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"
Sep 11 16:20:53.539554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.539513    2564 scope.go:117] "RemoveContainer" containerID="7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"
Sep 11 16:20:53.539833 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:20:53.539816    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e\": container with ID starting with 7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e not found: ID does not exist" containerID="7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"
Sep 11 16:20:53.539887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.539842    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e"} err="failed to get container status \"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e\": rpc error: code = NotFound desc = could not find container \"7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e\": container with ID starting with 7af3e5426651a90e13196edcc5716db291b6958065c0aeed27534d152d66698e not found: ID does not exist"
Sep 11 16:20:53.552235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.552178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.559100 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.559075    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:20:53.570034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.570009    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b6b139-7d798bdbcf-wh97q"]
Sep 11 16:20:53.692697 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.692648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.792351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.792321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:53.893857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:53.893759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:54.103209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:54.103174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:20:54.286956 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:54.286925    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" path="/var/lib/kubelet/pods/d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3/volumes"
Sep 11 16:20:56.306630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:20:56.306602    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:21:00.699991 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:00.699956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:00.769044 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:00.769010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:00.967974 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:00.967879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:01.526834 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:01.526791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:01.965582 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:01.965467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:02.150392 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.150357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:02.325092 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.325049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:02.425939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.425893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:02.559829 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.559790    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:21:02.560040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.560018    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy" containerID="cri-o://92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c" gracePeriod=30
Sep 11 16:21:02.600831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.600740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:02.957494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:02.957392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:03.073488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:03.073450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:03.166745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:03.166711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:05.470117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:05.470083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:05.583020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:05.582978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:06.414621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.414583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:06.665405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665322    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665723    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" containerName="maas-api"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665736    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" containerName="maas-api"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665753    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" containerName="main"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665758    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" containerName="main"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665766    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f804670-5e23-412a-886c-59de978107f7" containerName="main"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665771    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f804670-5e23-412a-886c-59de978107f7" containerName="main"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665785    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745d1687-1189-472e-bdc4-be348cd8e6f0" containerName="istio-proxy"
Sep 11 16:21:06.665791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665791    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="745d1687-1189-472e-bdc4-be348cd8e6f0" containerName="istio-proxy"
Sep 11 16:21:06.666059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665850    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2674ad-e0ce-44ba-9928-fdee2c9c325c" containerName="main"
Sep 11 16:21:06.666059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665857    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="745d1687-1189-472e-bdc4-be348cd8e6f0" containerName="istio-proxy"
Sep 11 16:21:06.666059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665864    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38e801c-0ba1-4fcc-90c7-9d6aaf220dd3" containerName="maas-api"
Sep 11 16:21:06.666059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.665871    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f804670-5e23-412a-886c-59de978107f7" containerName="main"
Sep 11 16:21:06.668809 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.668792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.678353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.678326    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:21:06.679477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.679459    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p2kww\""
Sep 11 16:21:06.680120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.680096    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:21:06.680324 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.680310    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:21:06.680404 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.680388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-1ec6e6-serving-cert\""
Sep 11 16:21:06.687299 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.687275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:21:06.704472 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.704432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:06.735065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.735015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.735268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.735082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljc6\" (UniqueName: \"kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.735268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.735145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.735268 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.735177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.799275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.799231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:06.836115 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.836077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.836309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.836128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.836309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.836188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.836309 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:06.836229    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-serving-cert: secret "maas-api-e2e-shared-a-w3-1ec6e6-serving-cert" not found
Sep 11 16:21:06.836309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.836241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljc6\" (UniqueName: \"kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.836309 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:06.836309    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls podName:f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b nodeName:}" failed. No retries permitted until 2026-09-11 16:21:07.336286621 +0000 UTC m=+1137.598532745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" (UID: "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b") : secret "maas-api-e2e-shared-a-w3-1ec6e6-serving-cert" not found
Sep 11 16:21:06.836967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.836939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.838935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.838914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:06.846467 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:06.846439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljc6\" (UniqueName: \"kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:07.013881 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.013841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:07.339788 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.339692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:07.342366 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.342341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:07.540192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.540158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:07.578698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.578669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:07.695185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.695150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:07.798742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.798710    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:21:07.842267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842377    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkp5v\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.842763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842493    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.842863    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.843091    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.843833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data" (OuterVolumeSpecName: "istio-data") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.843948    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.844381    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.844402    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.844416    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.844743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.844428    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.845328 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.845268    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v" (OuterVolumeSpecName: "kube-api-access-dkp5v") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "kube-api-access-dkp5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:21:07.845471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.845432    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:07.845816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.845784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token" (OuterVolumeSpecName: "istio-token") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:21:07.847607 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.847410    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:21:07.882155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.882128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:21:07.884075 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:21:07.884039    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9546ed0_0fd7_4f29_82fa_290ce1fa4e6b.slice/crio-d1a7c7982f35237de058b3fc124b9b43305494418bc0f04211527d42140f3eb1 WatchSource:0}: Error finding container d1a7c7982f35237de058b3fc124b9b43305494418bc0f04211527d42140f3eb1: Status 404 returned error can't find the container with id d1a7c7982f35237de058b3fc124b9b43305494418bc0f04211527d42140f3eb1
Sep 11 16:21:07.945155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket\") pod \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\" (UID: \"756a4aa4-3fb7-4510-895a-e2cb636d3d14\") "
Sep 11 16:21:07.945394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945368    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "756a4aa4-3fb7-4510-895a-e2cb636d3d14" (UID: "756a4aa4-3fb7-4510-895a-e2cb636d3d14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:07.945481 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945441    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkp5v\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-kube-api-access-dkp5v\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.945481 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945462    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.945481 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945478    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:07.945638 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:07.945491    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756a4aa4-3fb7-4510-895a-e2cb636d3d14-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:08.046917 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.046880    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756a4aa4-3fb7-4510-895a-e2cb636d3d14-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:21:08.618833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.618801    2564 generic.go:356] "Generic (PLEG): container finished" podID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerID="92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c" exitCode=0
Sep 11 16:21:08.619009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.618866    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"
Sep 11 16:21:08.619009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.618881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerDied","Data":"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"}
Sep 11 16:21:08.619009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.618932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q" event={"ID":"756a4aa4-3fb7-4510-895a-e2cb636d3d14","Type":"ContainerDied","Data":"d28c6f43be47eed9b8477fecf9013070887ebad954a36f5537419d1754ed5df7"}
Sep 11 16:21:08.619009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.618959    2564 scope.go:117] "RemoveContainer" containerID="92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"
Sep 11 16:21:08.621231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.621164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" event={"ID":"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b","Type":"ContainerStarted","Data":"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"}
Sep 11 16:21:08.621231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.621214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" event={"ID":"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b","Type":"ContainerStarted","Data":"d1a7c7982f35237de058b3fc124b9b43305494418bc0f04211527d42140f3eb1"}
Sep 11 16:21:08.621454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.621241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:08.628210 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.628194    2564 scope.go:117] "RemoveContainer" containerID="885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"
Sep 11 16:21:08.637020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.637001    2564 scope.go:117] "RemoveContainer" containerID="92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"
Sep 11 16:21:08.637331 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:08.637296    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c\": container with ID starting with 92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c not found: ID does not exist" containerID="92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"
Sep 11 16:21:08.637384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.637339    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c"} err="failed to get container status \"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c\": rpc error: code = NotFound desc = could not find container \"92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c\": container with ID starting with 92e80ce6b178c4b7174f464b43bc0f47592d6ca9a76f0a10185397c4aeda8c8c not found: ID does not exist"
Sep 11 16:21:08.637384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.637356    2564 scope.go:117] "RemoveContainer" containerID="885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"
Sep 11 16:21:08.637650 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:08.637635    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf\": container with ID starting with 885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf not found: ID does not exist" containerID="885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"
Sep 11 16:21:08.637700 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.637654    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf"} err="failed to get container status \"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf\": rpc error: code = NotFound desc = could not find container \"885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf\": container with ID starting with 885dccbe15116d506af360c8ce2c3ba3d81a0c8377115d0ac81eaf5f0d716fdf not found: ID does not exist"
Sep 11 16:21:08.652938 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.652905    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:21:08.673534 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:08.673502    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3882e47c-openshift-default-666747d56-9pv9q"]
Sep 11 16:21:10.287413 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:10.287371    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" path="/var/lib/kubelet/pods/756a4aa4-3fb7-4510-895a-e2cb636d3d14/volumes"
Sep 11 16:21:10.976674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:10.976608    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" podStartSLOduration=4.340507986 podStartE2EDuration="4.976588295s" totalImagesPullingTime="636.080309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:08.71324342 +0000 UTC m=+1138.975489562" watchObservedRunningTime="2026-09-11 16:21:10.976588295 +0000 UTC m=+1141.238834498"
Sep 11 16:21:10.978184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:10.978158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:21:11.892164 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:11.892134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:12.272937 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:12.272905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:12.636080 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:12.635995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:14.633230 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:14.633194    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:21:19.954572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:19.954507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:20.141145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:20.141114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:21.033153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.033119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:21.455152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455064    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:21:21.455672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455648    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.455672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455672    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.455918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455696    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.455918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455705    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.455918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455785    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.455918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.455796    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="756a4aa4-3fb7-4510-895a-e2cb636d3d14" containerName="istio-proxy"
Sep 11 16:21:21.460806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.460786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.464511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.464490    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-3db535-openshift-default-dockercfg-tvw4v\""
Sep 11 16:21:21.464821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.464803    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:21:21.563591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.563558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:21:21.578804 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.578777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.578804 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.578807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.578828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.578939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.578973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579172 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.579051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579172 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.579136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.579223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.579314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.579262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7w9v\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.594755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.594725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:21.680026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.679985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7w9v\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680394 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680651 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.680969 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.680939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.682716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.682696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.682855 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.682835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.706030 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.705951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7w9v\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.717372 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.717342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token\") pod \"e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") " pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.771648 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.771618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:21.871649 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:21.871618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:22.055428 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.055335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:21:22.057783 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:21:22.057755    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fa4747_cc45_4f21_a662_e23ebb6cba4c.slice/crio-ad8bd487c8cb6ee64da28857e06cf7cb1a4f9e21bda3289bdb71b798ab584f38 WatchSource:0}: Error finding container ad8bd487c8cb6ee64da28857e06cf7cb1a4f9e21bda3289bdb71b798ab584f38: Status 404 returned error can't find the container with id ad8bd487c8cb6ee64da28857e06cf7cb1a4f9e21bda3289bdb71b798ab584f38
Sep 11 16:21:22.060055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.060018    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:22.060139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.060091    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:22.060187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.060155    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:22.701630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.701585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerStarted","Data":"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"}
Sep 11 16:21:22.701844 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.701651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerStarted","Data":"ad8bd487c8cb6ee64da28857e06cf7cb1a4f9e21bda3289bdb71b798ab584f38"}
Sep 11 16:21:22.751195 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.751144    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podStartSLOduration=1.751125682 podStartE2EDuration="1.751125682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:22.74875407 +0000 UTC m=+1153.011000212" watchObservedRunningTime="2026-09-11 16:21:22.751125682 +0000 UTC m=+1153.013371823"
Sep 11 16:21:22.771963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:22.771930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:23.777656 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:23.777618    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:24.580082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:24.580048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:24.713095 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:24.713056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:24.714184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:24.714164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:24.940904 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:24.940784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:25.184876 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:25.184844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:26.540395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:26.540362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:28.328346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:28.328309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:28.530828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:28.530794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:29.323071 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:29.323038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:29.566434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:29.566395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:30.253093 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:30.253062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:30.415354 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:30.415321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:30.775803 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:30.775754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:31.148861 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.148780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:21:31.152548 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.152506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.158165 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.158140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-233d22-openshift-default-dockercfg-46rbc\""
Sep 11 16:21:31.178479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.178451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:21:31.192096 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.192062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:31.274449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrtd\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.274949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.274808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrtd\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.375965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.376212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.375980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.376276 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.376249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.376560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.376473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.378230 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.378209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.378334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.378271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.395874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.395844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrtd\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.406885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.406824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token\") pod \"e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") " pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.427493 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.427459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:31.464337 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.464297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:31.767037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.767012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:21:31.768914 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:21:31.768886    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc87014_1520_4da8_8e56_959bdfd0ea71.slice/crio-6fffc1e4b068bbabef2ae836fcab42eb132d4f7466400bc72727648c681ad923 WatchSource:0}: Error finding container 6fffc1e4b068bbabef2ae836fcab42eb132d4f7466400bc72727648c681ad923: Status 404 returned error can't find the container with id 6fffc1e4b068bbabef2ae836fcab42eb132d4f7466400bc72727648c681ad923
Sep 11 16:21:31.771043 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.771011    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:31.771134 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.771077    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:31.771134 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.771103    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:31.909512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:31.909473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:32.758591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:32.758554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerStarted","Data":"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"}
Sep 11 16:21:32.758771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:32.758618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerStarted","Data":"6fffc1e4b068bbabef2ae836fcab42eb132d4f7466400bc72727648c681ad923"}
Sep 11 16:21:32.800254 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:32.800202    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podStartSLOduration=1.8001856059999999 podStartE2EDuration="1.800185606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:32.797701932 +0000 UTC m=+1163.059948093" watchObservedRunningTime="2026-09-11 16:21:32.800185606 +0000 UTC m=+1163.062431748"
Sep 11 16:21:33.193054 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.192965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:33.310216 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.310183    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:21:33.464741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.464661    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:33.469940 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.469917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:33.764572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.764545    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:33.765596 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:33.765576    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:34.361393 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:34.361358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:35.003114 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:35.003079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:35.150595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:35.150561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:35.792548 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:35.792470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:36.787042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:36.787005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:37.738757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.738725    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:21:37.742579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.742557    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.745585 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.745561    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-233d22-serving-cert\""
Sep 11 16:21:37.762047 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.762014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:21:37.807561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.807075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:37.840254 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.840220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.840254 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.840258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.840538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.840286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.840538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.840385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q74j\" (UniqueName: \"kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.887545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.885187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:37.941406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.941361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.941618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.941414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.941618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.941451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.941618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.941490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q74j\" (UniqueName: \"kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.941618 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:37.941543    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-serving-cert: secret "maas-api-e2e-shared-b-w3-233d22-serving-cert" not found
Sep 11 16:21:37.941778 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:37.941622    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls podName:0d0282bb-03fb-4ca9-8525-00c88f4a240e nodeName:}" failed. No retries permitted until 2026-09-11 16:21:38.441599527 +0000 UTC m=+1168.703845667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls") pod "maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" (UID: "0d0282bb-03fb-4ca9-8525-00c88f4a240e") : secret "maas-api-e2e-shared-b-w3-233d22-serving-cert" not found
Sep 11 16:21:37.942212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.942181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.944085 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.944065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:37.950690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:37.950650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q74j\" (UniqueName: \"kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:38.019384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.019346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:38.386545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.386428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:38.445541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.445489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:38.447971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.447952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:38.571364 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.571334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:38.655433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.655339    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:38.971141 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:38.971055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:21:39.169757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.169703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:39.608792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.608760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:39.821436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.821397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" event={"ID":"0d0282bb-03fb-4ca9-8525-00c88f4a240e","Type":"ContainerStarted","Data":"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"}
Sep 11 16:21:39.821655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.821460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" event={"ID":"0d0282bb-03fb-4ca9-8525-00c88f4a240e","Type":"ContainerStarted","Data":"9ecc06b822118ec4bbf25b175760646fb9525439238fa9c8d5bc5e2586ba74ca"}
Sep 11 16:21:39.821655 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.821561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:39.874583 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:39.874503    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" podStartSLOduration=2.447809629 podStartE2EDuration="2.874487059s" totalImagesPullingTime="426.67743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:39.873034986 +0000 UTC m=+1170.135281128" watchObservedRunningTime="2026-09-11 16:21:39.874487059 +0000 UTC m=+1170.136733200"
Sep 11 16:21:40.013175 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:40.013137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:40.534242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:40.534168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:40.693170 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:40.693125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:40.876259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:40.876162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:42.086067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:42.086036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:43.069661 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.069628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:43.589849 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.589805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:43.688698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.688609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:43.850999 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.850969    2564 generic.go:356] "Generic (PLEG): container finished" podID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerID="dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480" exitCode=0
Sep 11 16:21:43.851203 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.851050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerDied","Data":"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"}
Sep 11 16:21:43.851506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.851489    2564 scope.go:117] "RemoveContainer" containerID="dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"
Sep 11 16:21:43.852635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.852609    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:43.852687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.852675    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:43.852727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:43.852705    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:44.315660 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:44.315626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:44.859034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:44.859005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerStarted","Data":"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"}
Sep 11 16:21:45.665336 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:45.665304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:45.772190 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:45.772149    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:45.772407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:45.772385    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 16:21:45.772479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:45.772461    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 16:21:45.833783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:45.833751    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:21:46.622565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:46.622502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:46.772843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:46.772805    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 16:21:46.773020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:46.772906    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 16:21:46.804208 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:46.804171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:21:47.773127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:47.773090    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 16:21:47.773561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:47.773161    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 16:21:48.023242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.023155    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:21:48.026177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.026152    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.030316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.030289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-7ce5d6-serving-cert\""
Sep 11 16:21:48.040928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.040903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.041069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.040953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.041069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.041015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.041069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.041048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trfcc\" (UniqueName: \"kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.041576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.041557    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:21:48.062968 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.062938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:48.130323 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.130278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:48.142513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.142483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trfcc\" (UniqueName: \"kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.142702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.142581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.142702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.142656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.142827 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.142786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.142965 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:48.142949    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-serving-cert: secret "maas-api-e2e-shared-b-w2-7ce5d6-serving-cert" not found
Sep 11 16:21:48.143044 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:21:48.143031    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls podName:84597efd-4c57-46a0-9daa-73721b52976d nodeName:}" failed. No retries permitted until 2026-09-11 16:21:48.642993607 +0000 UTC m=+1178.905239740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" (UID: "84597efd-4c57-46a0-9daa-73721b52976d") : secret "maas-api-e2e-shared-b-w2-7ce5d6-serving-cert" not found
Sep 11 16:21:48.143277 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.143253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.145782 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.145760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.151494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.151469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trfcc\" (UniqueName: \"kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.405754 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.405660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:48.570911 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.570873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:48.648805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.648757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.651617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.651596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:48.663272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.663205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:48.772738 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.772701    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 16:21:48.772910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.772758    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 16:21:48.939691 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:48.939586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:49.247338 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.247314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:21:49.248594 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:21:49.248562    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84597efd_4c57_46a0_9daa_73721b52976d.slice/crio-c1fefad7eeea924f0ee1ac9a0ebe634072e57250039ba436eda5b91e4ad534b9 WatchSource:0}: Error finding container c1fefad7eeea924f0ee1ac9a0ebe634072e57250039ba436eda5b91e4ad534b9: Status 404 returned error can't find the container with id c1fefad7eeea924f0ee1ac9a0ebe634072e57250039ba436eda5b91e4ad534b9
Sep 11 16:21:49.773273 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.772955    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 16:21:49.773273 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.773005    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 16:21:49.908251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.908153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" event={"ID":"84597efd-4c57-46a0-9daa-73721b52976d","Type":"ContainerStarted","Data":"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"}
Sep 11 16:21:49.908251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.908210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" event={"ID":"84597efd-4c57-46a0-9daa-73721b52976d","Type":"ContainerStarted","Data":"c1fefad7eeea924f0ee1ac9a0ebe634072e57250039ba436eda5b91e4ad534b9"}
Sep 11 16:21:49.908251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.908232    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:49.930935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:49.930875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" podStartSLOduration=2.563738119 podStartE2EDuration="2.93085605s" totalImagesPullingTime="367.117931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:49.929980858 +0000 UTC m=+1180.192227000" watchObservedRunningTime="2026-09-11 16:21:49.93085605 +0000 UTC m=+1180.193102193"
Sep 11 16:21:50.227490 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:50.227397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:50.782209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:50.782164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:50.783021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:50.782994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:50.789650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:50.789617    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:21:54.467113 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:54.467064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:55.921066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:55.921034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:21:57.960383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.960280    2564 generic.go:356] "Generic (PLEG): container finished" podID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerID="24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766" exitCode=0
Sep 11 16:21:57.960383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.960353    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerDied","Data":"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"}
Sep 11 16:21:57.960922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.960775    2564 scope.go:117] "RemoveContainer" containerID="24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"
Sep 11 16:21:57.961892 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.961861    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:57.961983 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.961927    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:57.961983 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:57.961961    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:21:58.968609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:58.968574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerStarted","Data":"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"}
Sep 11 16:21:59.163677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:59.163648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:21:59.464771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:59.464733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:21:59.465994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:59.465967    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:21:59.466128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:59.466017    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:21:59.599982 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:21:59.599938    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:22:00.465298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:00.465260    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:22:00.465715 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:00.465316    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:22:01.138161 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:01.138127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:01.465665 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:01.465576    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:22:01.465665 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:01.465645    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:22:01.986539 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:01.986243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:02.465666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:02.465626    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:22:02.466067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:02.465691    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:22:03.166235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:03.166199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:03.465169 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:03.465079    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:22:03.465169 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:03.465138    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:22:03.765300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:03.765260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:22:04.243138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:04.243038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:04.465715 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:04.465682    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 16:22:04.465911 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:04.465748    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 16:22:05.095326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:05.095293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:05.379414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:05.379319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:05.469894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:05.469865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:22:05.471048 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:05.471028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:22:06.458846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:06.458801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:07.475799 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:07.475768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:08.452672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:08.452640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:08.581311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:08.581276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:09.340613 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.340580    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7589-606ddc"]
Sep 11 16:22:09.343769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.343754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:09.346513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.346488    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xwld7\""
Sep 11 16:22:09.354405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.354380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-606ddc"]
Sep 11 16:22:09.447964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.447932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:09.488776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.488748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kdws\" (UniqueName: \"kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws\") pod \"test-curl-7589-606ddc\" (UID: \"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6\") " pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:09.589248 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.589210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kdws\" (UniqueName: \"kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws\") pod \"test-curl-7589-606ddc\" (UID: \"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6\") " pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:09.599138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.599053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kdws\" (UniqueName: \"kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws\") pod \"test-curl-7589-606ddc\" (UID: \"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6\") " pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:09.655000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.654947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:09.927489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:09.927460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-606ddc"]
Sep 11 16:22:09.928561 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:09.928535    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf55bb384_ed3e_455c_9cc9_7a5d8cf3b9c6.slice/crio-cd717b33ebc93661c8fd31d6492bee7c364a7354ccec5c2ff9285762c14a0c5b WatchSource:0}: Error finding container cd717b33ebc93661c8fd31d6492bee7c364a7354ccec5c2ff9285762c14a0c5b: Status 404 returned error can't find the container with id cd717b33ebc93661c8fd31d6492bee7c364a7354ccec5c2ff9285762c14a0c5b
Sep 11 16:22:10.046147 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.046111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-606ddc" event={"ID":"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6","Type":"ContainerStarted","Data":"b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1"}
Sep 11 16:22:10.046318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.046154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-606ddc" event={"ID":"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6","Type":"ContainerStarted","Data":"cd717b33ebc93661c8fd31d6492bee7c364a7354ccec5c2ff9285762c14a0c5b"}
Sep 11 16:22:10.067822 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.067769    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7589-606ddc" podStartSLOduration=1.067751028 podStartE2EDuration="1.067751028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:10.065397702 +0000 UTC m=+1200.327643844" watchObservedRunningTime="2026-09-11 16:22:10.067751028 +0000 UTC m=+1200.329997170"
Sep 11 16:22:10.302704 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.302674    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:22:10.308499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.308470    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:22:10.366994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.366953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:10.407780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.407752    2564 scope.go:117] "RemoveContainer" containerID="4e9a3c2af21aa095b16b8ff0dce7bfc3d5fe8fc8b402fbb343d1aea7dd333997"
Sep 11 16:22:10.788144 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.788030    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7589-606ddc"]
Sep 11 16:22:10.793678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.793646    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7589-606ddc"]
Sep 11 16:22:10.979872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.979836    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7589-7465f4"]
Sep 11 16:22:10.980249 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.980236    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" containerName="test-curl-7589-606ddc"
Sep 11 16:22:10.980297 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.980251    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" containerName="test-curl-7589-606ddc"
Sep 11 16:22:10.980332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.980315    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" containerName="test-curl-7589-606ddc"
Sep 11 16:22:10.984757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.984740    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:10.998177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:10.998148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-7465f4"]
Sep 11 16:22:11.052413 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:11.052327    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7589-606ddc" container="test-curl-7589-606ddc"
Sep 11 16:22:11.104609 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:11.104574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9zw\" (UniqueName: \"kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw\") pod \"test-curl-7589-7465f4\" (UID: \"61526fe3-595b-41f8-b877-e17378bbc0c6\") " pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:11.205772 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:11.205727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9zw\" (UniqueName: \"kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw\") pod \"test-curl-7589-7465f4\" (UID: \"61526fe3-595b-41f8-b877-e17378bbc0c6\") " pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:11.220559 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:11.220506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9zw\" (UniqueName: \"kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw\") pod \"test-curl-7589-7465f4\" (UID: \"61526fe3-595b-41f8-b877-e17378bbc0c6\") " pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:11.293487 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:11.293451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:11.567034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:11.567010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-7465f4"]
Sep 11 16:22:11.569464 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:11.569437    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61526fe3_595b_41f8_b877_e17378bbc0c6.slice/crio-452e203f10c62a7860a16c5512809fbe83e411e18d46db321cbf4af3f15a6d6f WatchSource:0}: Error finding container 452e203f10c62a7860a16c5512809fbe83e411e18d46db321cbf4af3f15a6d6f: Status 404 returned error can't find the container with id 452e203f10c62a7860a16c5512809fbe83e411e18d46db321cbf4af3f15a6d6f
Sep 11 16:22:12.060323 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.060291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-7465f4" event={"ID":"61526fe3-595b-41f8-b877-e17378bbc0c6","Type":"ContainerStarted","Data":"dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59"}
Sep 11 16:22:12.060736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.060332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-7465f4" event={"ID":"61526fe3-595b-41f8-b877-e17378bbc0c6","Type":"ContainerStarted","Data":"452e203f10c62a7860a16c5512809fbe83e411e18d46db321cbf4af3f15a6d6f"}
Sep 11 16:22:12.060736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.060570    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7589-606ddc" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" containerName="test-curl-7589-606ddc" containerID="cri-o://b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1" gracePeriod=2
Sep 11 16:22:12.081783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.081732    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7589-7465f4" podStartSLOduration=2.081715954 podStartE2EDuration="2.081715954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:12.08025275 +0000 UTC m=+1202.342498896" watchObservedRunningTime="2026-09-11 16:22:12.081715954 +0000 UTC m=+1202.343962096"
Sep 11 16:22:12.082893 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:12.082869    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-606ddc\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:12.701160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.701124    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7589-7465f4"]
Sep 11 16:22:12.705924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.705896    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7589-7465f4"]
Sep 11 16:22:12.820996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.820957    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7589-6d9da1"]
Sep 11 16:22:12.821368 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.821356    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" containerName="test-curl-7589-7465f4"
Sep 11 16:22:12.821415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.821370    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" containerName="test-curl-7589-7465f4"
Sep 11 16:22:12.821450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.821439    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" containerName="test-curl-7589-7465f4"
Sep 11 16:22:12.824593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.824576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:12.832538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.832262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-6d9da1"]
Sep 11 16:22:12.921379 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:12.921343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnk2d\" (UniqueName: \"kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d\") pod \"test-curl-7589-6d9da1\" (UID: \"7849ee38-750e-410b-8aed-bf9507a7f5a5\") " pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:13.022654 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:13.022617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnk2d\" (UniqueName: \"kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d\") pod \"test-curl-7589-6d9da1\" (UID: \"7849ee38-750e-410b-8aed-bf9507a7f5a5\") " pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:13.031903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:13.031875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnk2d\" (UniqueName: \"kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d\") pod \"test-curl-7589-6d9da1\" (UID: \"7849ee38-750e-410b-8aed-bf9507a7f5a5\") " pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:13.066615 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:13.066588    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7589-7465f4" container="test-curl-7589-7465f4"
Sep 11 16:22:13.136163 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:13.136069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:13.418285 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:13.418255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-6d9da1"]
Sep 11 16:22:13.419990 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:13.419957    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7849ee38_750e_410b_8aed_bf9507a7f5a5.slice/crio-d5b27a4e6dd9c4b850e7b139642cad567434b92c5805840718983749e05a4a4e WatchSource:0}: Error finding container d5b27a4e6dd9c4b850e7b139642cad567434b92c5805840718983749e05a4a4e: Status 404 returned error can't find the container with id d5b27a4e6dd9c4b850e7b139642cad567434b92c5805840718983749e05a4a4e
Sep 11 16:22:14.073843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.073812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-6d9da1" event={"ID":"7849ee38-750e-410b-8aed-bf9507a7f5a5","Type":"ContainerStarted","Data":"9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a"}
Sep 11 16:22:14.074231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.073862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-6d9da1" event={"ID":"7849ee38-750e-410b-8aed-bf9507a7f5a5","Type":"ContainerStarted","Data":"d5b27a4e6dd9c4b850e7b139642cad567434b92c5805840718983749e05a4a4e"}
Sep 11 16:22:14.074231 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.073895    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7589-7465f4" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" containerName="test-curl-7589-7465f4" containerID="cri-o://dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59" gracePeriod=2
Sep 11 16:22:14.105209 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.105156    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7589-6d9da1" podStartSLOduration=2.105139676 podStartE2EDuration="2.105139676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:14.103125245 +0000 UTC m=+1204.365371388" watchObservedRunningTime="2026-09-11 16:22:14.105139676 +0000 UTC m=+1204.367385818"
Sep 11 16:22:14.105388 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:14.105336    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-7465f4\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:14.107350 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:14.107326    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-7465f4\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:14.240603 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.240576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:14.242833 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:14.242808    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-7465f4\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:14.333408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.333335    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kdws\" (UniqueName: \"kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws\") pod \"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6\" (UID: \"f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6\") "
Sep 11 16:22:14.335592 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.335563    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws" (OuterVolumeSpecName: "kube-api-access-9kdws") pod "f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" (UID: "f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6"). InnerVolumeSpecName "kube-api-access-9kdws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:22:14.435313 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.435282    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kdws\" (UniqueName: \"kubernetes.io/projected/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6-kube-api-access-9kdws\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:22:14.702955 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.702868    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7589-6d9da1"]
Sep 11 16:22:14.707631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.707600    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7589-6d9da1"]
Sep 11 16:22:14.827789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.827756    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7589-47be55"]
Sep 11 16:22:14.828169 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.828154    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" containerName="test-curl-7589-6d9da1"
Sep 11 16:22:14.828214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.828170    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" containerName="test-curl-7589-6d9da1"
Sep 11 16:22:14.828252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.828246    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" containerName="test-curl-7589-6d9da1"
Sep 11 16:22:14.831308 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.831288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:14.838060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.838032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-47be55"]
Sep 11 16:22:14.940507 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:14.940464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54xmz\" (UniqueName: \"kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz\") pod \"test-curl-7589-47be55\" (UID: \"a145477a-88a9-4afa-9a64-437017a9b5e4\") " pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:15.041346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.041310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54xmz\" (UniqueName: \"kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz\") pod \"test-curl-7589-47be55\" (UID: \"a145477a-88a9-4afa-9a64-437017a9b5e4\") " pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:15.050132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.050099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54xmz\" (UniqueName: \"kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz\") pod \"test-curl-7589-47be55\" (UID: \"a145477a-88a9-4afa-9a64-437017a9b5e4\") " pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:15.080681 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.080648    2564 generic.go:356] "Generic (PLEG): container finished" podID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" containerID="b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1" exitCode=137
Sep 11 16:22:15.081074 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.080702    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-606ddc"
Sep 11 16:22:15.081074 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.080751    2564 scope.go:117] "RemoveContainer" containerID="b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1"
Sep 11 16:22:15.081074 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:15.080946    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7589-6d9da1" container="test-curl-7589-6d9da1"
Sep 11 16:22:15.090227 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.090209    2564 scope.go:117] "RemoveContainer" containerID="b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1"
Sep 11 16:22:15.090578 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:15.090559    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1\": container with ID starting with b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1 not found: ID does not exist" containerID="b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1"
Sep 11 16:22:15.090624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.090589    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1"} err="failed to get container status \"b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1\": rpc error: code = NotFound desc = could not find container \"b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1\": container with ID starting with b616fd5680c6a3cdf4920d2560db0eeb47d9a80e01298e6b84e382ca829ddcb1 not found: ID does not exist"
Sep 11 16:22:15.143097 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.143061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:15.416059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:15.416028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7589-47be55"]
Sep 11 16:22:15.417408 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:15.417384    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda145477a_88a9_4afa_9a64_437017a9b5e4.slice/crio-b3611a5111e713a37153da6a0be6b2dff89240459a4b9fb6948fd961d9820393 WatchSource:0}: Error finding container b3611a5111e713a37153da6a0be6b2dff89240459a4b9fb6948fd961d9820393: Status 404 returned error can't find the container with id b3611a5111e713a37153da6a0be6b2dff89240459a4b9fb6948fd961d9820393
Sep 11 16:22:16.090899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.090861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-47be55" event={"ID":"a145477a-88a9-4afa-9a64-437017a9b5e4","Type":"ContainerStarted","Data":"ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d"}
Sep 11 16:22:16.091263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.090914    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7589-47be55" event={"ID":"a145477a-88a9-4afa-9a64-437017a9b5e4","Type":"ContainerStarted","Data":"b3611a5111e713a37153da6a0be6b2dff89240459a4b9fb6948fd961d9820393"}
Sep 11 16:22:16.091263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.090942    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7589-6d9da1" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" containerName="test-curl-7589-6d9da1" containerID="cri-o://9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a" gracePeriod=2
Sep 11 16:22:16.093446 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:16.093423    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-6d9da1\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:16.111541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.111472    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7589-47be55" podStartSLOduration=2.111456341 podStartE2EDuration="2.111456341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:16.11023719 +0000 UTC m=+1206.372483335" watchObservedRunningTime="2026-09-11 16:22:16.111456341 +0000 UTC m=+1206.373702483"
Sep 11 16:22:16.112537 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:16.112495    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-6d9da1\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:16.260398 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.260374    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:16.262894 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:16.262870    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-6d9da1\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:16.287154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.287122    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6" path="/var/lib/kubelet/pods/f55bb384-ed3e-455c-9cc9-7a5d8cf3b9c6/volumes"
Sep 11 16:22:16.352785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.352704    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn9zw\" (UniqueName: \"kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw\") pod \"61526fe3-595b-41f8-b877-e17378bbc0c6\" (UID: \"61526fe3-595b-41f8-b877-e17378bbc0c6\") "
Sep 11 16:22:16.354806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.354778    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw" (OuterVolumeSpecName: "kube-api-access-cn9zw") pod "61526fe3-595b-41f8-b877-e17378bbc0c6" (UID: "61526fe3-595b-41f8-b877-e17378bbc0c6"). InnerVolumeSpecName "kube-api-access-cn9zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:22:16.454284 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.454244    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn9zw\" (UniqueName: \"kubernetes.io/projected/61526fe3-595b-41f8-b877-e17378bbc0c6-kube-api-access-cn9zw\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:22:16.705922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.705831    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7589-47be55"]
Sep 11 16:22:16.709745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.709714    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7589-47be55"]
Sep 11 16:22:16.870207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.870172    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:22:16.870690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.870671    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" containerName="test-curl-7589-47be55"
Sep 11 16:22:16.870690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.870691    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" containerName="test-curl-7589-47be55"
Sep 11 16:22:16.870854 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.870802    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" containerName="test-curl-7589-47be55"
Sep 11 16:22:16.874066 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.874043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.878221 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.878194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"default-dockercfg-sljwk\""
Sep 11 16:22:16.878351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.878228    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"kube-root-ca.crt\""
Sep 11 16:22:16.878351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.878194    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"openshift-service-ca.crt\""
Sep 11 16:22:16.878461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.878385    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"auth-test-model-1ec6e6-kserve-self-signed-certs\""
Sep 11 16:22:16.886056 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.886029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:22:16.900040 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.900016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:16.958434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.958434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hk6r\" (UniqueName: \"kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.958643 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.958643 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.958643 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:16.958762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:16.958649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059386 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hk6r\" (UniqueName: \"kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059631 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.059985 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.059966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.060060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.060026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.060060 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.060053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.062039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.062020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.062173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.062155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.068781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.068754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hk6r\" (UniqueName: \"kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r\") pod \"auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.098440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.098407    2564 generic.go:356] "Generic (PLEG): container finished" podID="61526fe3-595b-41f8-b877-e17378bbc0c6" containerID="dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59" exitCode=137
Sep 11 16:22:17.098927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.098466    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-7465f4"
Sep 11 16:22:17.098927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.098510    2564 scope.go:117] "RemoveContainer" containerID="dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59"
Sep 11 16:22:17.098927 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:17.098773    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7589-47be55" container="test-curl-7589-47be55"
Sep 11 16:22:17.108896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.108873    2564 scope.go:117] "RemoveContainer" containerID="dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59"
Sep 11 16:22:17.109199 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:17.109182    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59\": container with ID starting with dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59 not found: ID does not exist" containerID="dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59"
Sep 11 16:22:17.109251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.109208    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59"} err="failed to get container status \"dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59\": rpc error: code = NotFound desc = could not find container \"dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59\": container with ID starting with dc9b9da61a92700e50bc203efb62b4381439b01d6bd3a9da5087cb925a819c59 not found: ID does not exist"
Sep 11 16:22:17.184488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.184451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:17.320433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.320395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:17.464256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.464230    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:22:17.465097 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:17.465068    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf04bfac0_1989_4e04_8504_78fd7176d40d.slice/crio-b8053e94da69028820d8e4657b6843b3c21b486c68657691a5f9c3df4aa66570 WatchSource:0}: Error finding container b8053e94da69028820d8e4657b6843b3c21b486c68657691a5f9c3df4aa66570: Status 404 returned error can't find the container with id b8053e94da69028820d8e4657b6843b3c21b486c68657691a5f9c3df4aa66570
Sep 11 16:22:17.637706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:17.637672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:18.105707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.105675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" event={"ID":"f04bfac0-1989-4e04-8504-78fd7176d40d","Type":"ContainerStarted","Data":"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"}
Sep 11 16:22:18.106076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.105720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" event={"ID":"f04bfac0-1989-4e04-8504-78fd7176d40d","Type":"ContainerStarted","Data":"b8053e94da69028820d8e4657b6843b3c21b486c68657691a5f9c3df4aa66570"}
Sep 11 16:22:18.106812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.106784    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7589-47be55" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" containerName="test-curl-7589-47be55" containerID="cri-o://ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d" gracePeriod=2
Sep 11 16:22:18.123007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.122934    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" podStartSLOduration=2.122910232 podStartE2EDuration="2.122910232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:18.122374871 +0000 UTC m=+1208.384621027" watchObservedRunningTime="2026-09-11 16:22:18.122910232 +0000 UTC m=+1208.385156387"
Sep 11 16:22:18.124449 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:18.124416    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-47be55\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:18.208930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.208896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:18.273702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.273678    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:18.276030 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:18.276006    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-47be55\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:18.286647 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.286614    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61526fe3-595b-41f8-b877-e17378bbc0c6" path="/var/lib/kubelet/pods/61526fe3-595b-41f8-b877-e17378bbc0c6/volumes"
Sep 11 16:22:18.372005 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.371921    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnk2d\" (UniqueName: \"kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d\") pod \"7849ee38-750e-410b-8aed-bf9507a7f5a5\" (UID: \"7849ee38-750e-410b-8aed-bf9507a7f5a5\") "
Sep 11 16:22:18.374184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.374160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d" (OuterVolumeSpecName: "kube-api-access-rnk2d") pod "7849ee38-750e-410b-8aed-bf9507a7f5a5" (UID: "7849ee38-750e-410b-8aed-bf9507a7f5a5"). InnerVolumeSpecName "kube-api-access-rnk2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:22:18.473292 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:18.473261    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnk2d\" (UniqueName: \"kubernetes.io/projected/7849ee38-750e-410b-8aed-bf9507a7f5a5-kube-api-access-rnk2d\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:22:19.114111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:19.114076    2564 generic.go:356] "Generic (PLEG): container finished" podID="7849ee38-750e-410b-8aed-bf9507a7f5a5" containerID="9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a" exitCode=137
Sep 11 16:22:19.114604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:19.114120    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-6d9da1"
Sep 11 16:22:19.114604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:19.114182    2564 scope.go:117] "RemoveContainer" containerID="9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a"
Sep 11 16:22:19.124080 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:19.124061    2564 scope.go:117] "RemoveContainer" containerID="9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a"
Sep 11 16:22:19.124347 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:19.124329    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a\": container with ID starting with 9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a not found: ID does not exist" containerID="9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a"
Sep 11 16:22:19.124412 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:19.124359    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a"} err="failed to get container status \"9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a\": rpc error: code = NotFound desc = could not find container \"9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a\": container with ID starting with 9f0903cab9b45f65109d998cd4e3d22d056b04626e6fbd7619a418db06dc2e2a not found: ID does not exist"
Sep 11 16:22:20.141038 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.141007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:20.286933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.286901    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7849ee38-750e-410b-8aed-bf9507a7f5a5" path="/var/lib/kubelet/pods/7849ee38-750e-410b-8aed-bf9507a7f5a5/volumes"
Sep 11 16:22:20.302671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.302649    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:20.304981 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:20.304956    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-47be55\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:20.392673 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.392586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54xmz\" (UniqueName: \"kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz\") pod \"a145477a-88a9-4afa-9a64-437017a9b5e4\" (UID: \"a145477a-88a9-4afa-9a64-437017a9b5e4\") "
Sep 11 16:22:20.394906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.394885    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz" (OuterVolumeSpecName: "kube-api-access-54xmz") pod "a145477a-88a9-4afa-9a64-437017a9b5e4" (UID: "a145477a-88a9-4afa-9a64-437017a9b5e4"). InnerVolumeSpecName "kube-api-access-54xmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:22:20.493356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.493324    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54xmz\" (UniqueName: \"kubernetes.io/projected/a145477a-88a9-4afa-9a64-437017a9b5e4-kube-api-access-54xmz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:22:20.769180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.769152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:20.865604 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:20.865575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:21.067067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.066977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:21.128039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.128004    2564 generic.go:356] "Generic (PLEG): container finished" podID="a145477a-88a9-4afa-9a64-437017a9b5e4" containerID="ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d" exitCode=137
Sep 11 16:22:21.128242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.128056    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:21.128242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.128066    2564 scope.go:117] "RemoveContainer" containerID="ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d"
Sep 11 16:22:21.131495 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:21.131458    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-47be55\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:21.144082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.144061    2564 scope.go:117] "RemoveContainer" containerID="ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d"
Sep 11 16:22:21.144399 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:21.144378    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d\": container with ID starting with ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d not found: ID does not exist" containerID="ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d"
Sep 11 16:22:21.144441 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.144407    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d"} err="failed to get container status \"ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d\": rpc error: code = NotFound desc = could not find container \"ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d\": container with ID starting with ada3910f71091a5b37302243d3c7c4c69c6c4422e7c4ba7a834ed309588c218d not found: ID does not exist"
Sep 11 16:22:21.144718 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:21.144698    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7589-47be55\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" pod="opendatahub/test-curl-7589-47be55"
Sep 11 16:22:21.862787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:21.862755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:22.088733 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:22.088692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:22:22.287678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:22.287641    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a145477a-88a9-4afa-9a64-437017a9b5e4" path="/var/lib/kubelet/pods/a145477a-88a9-4afa-9a64-437017a9b5e4/volumes"
Sep 11 16:22:22.742896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:22.742802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:23.641663 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:23.641636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:24.378429 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.378394    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:22:24.383555 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.383531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.386719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.386695    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0a17a0fd-serving-cert\""
Sep 11 16:22:24.398509 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.398484    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:22:24.423197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.423162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:24.431320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.431288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.431461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.431326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.431461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.431349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvrb\" (UniqueName: \"kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.431461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.431400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.524561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.524499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:24.532760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.532733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.532922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.532766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.532922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.532787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvrb\" (UniqueName: \"kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.532922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.532888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.533060 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:24.533003    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-serving-cert: secret "maas-api-e2e-mt-0a17a0fd-serving-cert" not found
Sep 11 16:22:24.533105 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:22:24.533078    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls podName:d922f1d8-0277-4a40-9738-7a48fab60a47 nodeName:}" failed. No retries permitted until 2026-09-11 16:22:25.033058007 +0000 UTC m=+1215.295304132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls") pod "maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" (UID: "d922f1d8-0277-4a40-9738-7a48fab60a47") : secret "maas-api-e2e-mt-0a17a0fd-serving-cert" not found
Sep 11 16:22:24.533440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.533421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.535530 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.535502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.542645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.542620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvrb\" (UniqueName: \"kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:24.729350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.729255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:24.920658 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:24.920624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:25.016727 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:25.016695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:25.038360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:25.038322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:25.041008 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:25.040990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") pod \"maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:25.295363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:25.295279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:25.570133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:25.570104    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:22:25.571484 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:25.571449    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd922f1d8_0277_4a40_9738_7a48fab60a47.slice/crio-e869f814a0b2f857564d962c25c49c750fce290e6b7805c1fc619e9b25f13b94 WatchSource:0}: Error finding container e869f814a0b2f857564d962c25c49c750fce290e6b7805c1fc619e9b25f13b94: Status 404 returned error can't find the container with id e869f814a0b2f857564d962c25c49c750fce290e6b7805c1fc619e9b25f13b94
Sep 11 16:22:26.159405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:26.159368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" event={"ID":"d922f1d8-0277-4a40-9738-7a48fab60a47","Type":"ContainerStarted","Data":"06acebe507ff0f267b0312bac95aa663d2bc3ff50a50b4e23b2710445380cbf4"}
Sep 11 16:22:26.159859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:26.159420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" event={"ID":"d922f1d8-0277-4a40-9738-7a48fab60a47","Type":"ContainerStarted","Data":"e869f814a0b2f857564d962c25c49c750fce290e6b7805c1fc619e9b25f13b94"}
Sep 11 16:22:26.159859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:26.159536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:26.180957 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:26.180896    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" podStartSLOduration=1.7058236249999998 podStartE2EDuration="2.180877573s" totalImagesPullingTime="475.053948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:26.178469013 +0000 UTC m=+1216.440715167" watchObservedRunningTime="2026-09-11 16:22:26.180877573 +0000 UTC m=+1216.443123714"
Sep 11 16:22:27.185289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:27.185245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:27.185289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:27.185298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:27.198027 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:27.198000    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:28.185322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:28.185294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:22:32.173082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:32.173050    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:22:36.072444 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:36.072409    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:22:43.479807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.479774    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:22:43.483744 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.483724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.486711 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.486691    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"kube-root-ca.crt\""
Sep 11 16:22:43.487672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.487657    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"openshift-service-ca.crt\""
Sep 11 16:22:43.487672 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.487663    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"auth-test-model-233d22-kserve-self-signed-certs\""
Sep 11 16:22:43.487839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.487820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"default-dockercfg-t75gx\""
Sep 11 16:22:43.492945 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.492921    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:22:43.517653 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.517616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:43.631219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gcz\" (UniqueName: \"kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.631403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.631403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.631403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.631543 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.631543 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.631485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733032 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.732936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gcz\" (UniqueName: \"kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733032 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.732998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733032 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.733693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.733628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.735677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.735659    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.735852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.735834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.742121 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.742100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gcz\" (UniqueName: \"kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz\") pod \"auth-test-model-233d22-kserve-7d4d9fd879-xrccl\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") " pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:43.794541 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:43.794481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:44.071615 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:44.071573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:22:44.072744 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:22:44.072718    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa0d252e_2ff8_45f4_982d_966886594160.slice/crio-6c7123398cef524880cae074dcbeb9b5187312ed059cecdd5c6587bee753e624 WatchSource:0}: Error finding container 6c7123398cef524880cae074dcbeb9b5187312ed059cecdd5c6587bee753e624: Status 404 returned error can't find the container with id 6c7123398cef524880cae074dcbeb9b5187312ed059cecdd5c6587bee753e624
Sep 11 16:22:44.277278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:44.277238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" event={"ID":"aa0d252e-2ff8-45f4-982d-966886594160","Type":"ContainerStarted","Data":"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"}
Sep 11 16:22:44.277278 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:44.277280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" event={"ID":"aa0d252e-2ff8-45f4-982d-966886594160","Type":"ContainerStarted","Data":"6c7123398cef524880cae074dcbeb9b5187312ed059cecdd5c6587bee753e624"}
Sep 11 16:22:44.299815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:44.299761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" podStartSLOduration=1.29974623 podStartE2EDuration="1.29974623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:44.297627098 +0000 UTC m=+1234.559873255" watchObservedRunningTime="2026-09-11 16:22:44.29974623 +0000 UTC m=+1234.561992372"
Sep 11 16:22:46.912457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:46.912420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:47.488237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:47.488200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:22:48.688303 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:48.688265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:48.827184 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:48.827153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:49.826749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:49.826714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:50.775741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:50.775702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:50.943318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:50.943275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:51.867078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:51.867050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:22:53.794806 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:53.794769    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:53.795235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:53.794828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:53.807883 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:53.807855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:22:54.352131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:22:54.352096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:23:03.240913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:03.240816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:03.339785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:03.339738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:03.476843 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:03.476811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:09.732887 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:09.732852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:23:24.458438 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:24.458402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:24.472953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:24.472926    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:23:33.114955 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:33.114882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:33.186132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:33.186099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:42.581485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:42.581453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:23:46.755188 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:46.755155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:47.864629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:47.864590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:48.853792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:48.853755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:49.834077 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:49.834048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:50.554644 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:50.554612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:23:51.452678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:23:51.452643    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:01.408237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.408202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:24:01.543225 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.543193    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:24:01.543433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.543411    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" podUID="d922f1d8-0277-4a40-9738-7a48fab60a47" containerName="maas-api" containerID="cri-o://06acebe507ff0f267b0312bac95aa663d2bc3ff50a50b4e23b2710445380cbf4" gracePeriod=30
Sep 11 16:24:01.592996 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.592959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:01.722856 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.722700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:01.745739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.745707    2564 generic.go:356] "Generic (PLEG): container finished" podID="d922f1d8-0277-4a40-9738-7a48fab60a47" containerID="06acebe507ff0f267b0312bac95aa663d2bc3ff50a50b4e23b2710445380cbf4" exitCode=0
Sep 11 16:24:01.745937 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.745784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" event={"ID":"d922f1d8-0277-4a40-9738-7a48fab60a47","Type":"ContainerDied","Data":"06acebe507ff0f267b0312bac95aa663d2bc3ff50a50b4e23b2710445380cbf4"}
Sep 11 16:24:01.802344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.802314    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:24:01.820070 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.820038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:01.828282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828258    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca\") pod \"d922f1d8-0277-4a40-9738-7a48fab60a47\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") "
Sep 11 16:24:01.828419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828317    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs\") pod \"d922f1d8-0277-4a40-9738-7a48fab60a47\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") "
Sep 11 16:24:01.828419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828352    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") pod \"d922f1d8-0277-4a40-9738-7a48fab60a47\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") "
Sep 11 16:24:01.828419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqvrb\" (UniqueName: \"kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb\") pod \"d922f1d8-0277-4a40-9738-7a48fab60a47\" (UID: \"d922f1d8-0277-4a40-9738-7a48fab60a47\") "
Sep 11 16:24:01.828657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d922f1d8-0277-4a40-9738-7a48fab60a47" (UID: "d922f1d8-0277-4a40-9738-7a48fab60a47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:24:01.828745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.828729    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d922f1d8-0277-4a40-9738-7a48fab60a47-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:24:01.830635 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.830605    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d922f1d8-0277-4a40-9738-7a48fab60a47" (UID: "d922f1d8-0277-4a40-9738-7a48fab60a47"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:24:01.830753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.830667    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d922f1d8-0277-4a40-9738-7a48fab60a47" (UID: "d922f1d8-0277-4a40-9738-7a48fab60a47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:24:01.830753 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.830699    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb" (OuterVolumeSpecName: "kube-api-access-bqvrb") pod "d922f1d8-0277-4a40-9738-7a48fab60a47" (UID: "d922f1d8-0277-4a40-9738-7a48fab60a47"). InnerVolumeSpecName "kube-api-access-bqvrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:24:01.920464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.920414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:01.929781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.929750    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:24:01.929781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.929779    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqvrb\" (UniqueName: \"kubernetes.io/projected/d922f1d8-0277-4a40-9738-7a48fab60a47-kube-api-access-bqvrb\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:24:01.929781 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:01.929788    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d922f1d8-0277-4a40-9738-7a48fab60a47-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:24:02.005569 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.005447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:02.359099 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.359042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:02.753589 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.753494    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"
Sep 11 16:24:02.754023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.753508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf" event={"ID":"d922f1d8-0277-4a40-9738-7a48fab60a47","Type":"ContainerDied","Data":"e869f814a0b2f857564d962c25c49c750fce290e6b7805c1fc619e9b25f13b94"}
Sep 11 16:24:02.754023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.753659    2564 scope.go:117] "RemoveContainer" containerID="06acebe507ff0f267b0312bac95aa663d2bc3ff50a50b4e23b2710445380cbf4"
Sep 11 16:24:02.776513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.776477    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:24:02.781917 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:02.781879    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a17a0fd-576694b587-fqvzf"]
Sep 11 16:24:03.254573 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:03.254539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:04.008402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:04.008369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:04.288226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:04.288145    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d922f1d8-0277-4a40-9738-7a48fab60a47" path="/var/lib/kubelet/pods/d922f1d8-0277-4a40-9738-7a48fab60a47/volumes"
Sep 11 16:24:04.973225 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:04.973188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:05.072117 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:05.072071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:05.754565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:05.754513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:10.033755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:10.033705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:17.875307 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:17.875267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:24:35.584845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:35.584756    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:24:46.348553 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:46.348500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:47.990797 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:47.990761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:51.874440 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:51.874403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:24:54.238201 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:54.238162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:54.343214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:54.343175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:54.543426 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:54.543392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:55.937094 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:55.937062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:56.034304 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:56.034267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:56.134101 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:56.134062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:56.825362 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:56.825333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:56.919479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:56.919444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:57.017862 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:57.017814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:24:58.263908 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:24:58.263871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:02.389513 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.389459    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7592-a760b7"]
Sep 11 16:25:02.389928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.389891    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d922f1d8-0277-4a40-9738-7a48fab60a47" containerName="maas-api"
Sep 11 16:25:02.389928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.389903    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d922f1d8-0277-4a40-9738-7a48fab60a47" containerName="maas-api"
Sep 11 16:25:02.390019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.390007    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d922f1d8-0277-4a40-9738-7a48fab60a47" containerName="maas-api"
Sep 11 16:25:02.393256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.393238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:02.396183 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.396163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xwld7\""
Sep 11 16:25:02.402148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.402076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-a760b7"]
Sep 11 16:25:02.548783 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.548741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvgc\" (UniqueName: \"kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc\") pod \"test-curl-7592-a760b7\" (UID: \"9b049d60-2167-4693-b365-c1ef3ee3c4c7\") " pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:02.650063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.649968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvgc\" (UniqueName: \"kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc\") pod \"test-curl-7592-a760b7\" (UID: \"9b049d60-2167-4693-b365-c1ef3ee3c4c7\") " pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:02.660792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.660753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvgc\" (UniqueName: \"kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc\") pod \"test-curl-7592-a760b7\" (UID: \"9b049d60-2167-4693-b365-c1ef3ee3c4c7\") " pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:02.704956 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.704903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:02.985884 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:02.985857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-a760b7"]
Sep 11 16:25:02.987584 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:25:02.987559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b049d60_2167_4693_b365_c1ef3ee3c4c7.slice/crio-3c512ece6ea37b2b36ba8165c95ea35542eba46dc46d70f2083dabc24350a853 WatchSource:0}: Error finding container 3c512ece6ea37b2b36ba8165c95ea35542eba46dc46d70f2083dabc24350a853: Status 404 returned error can't find the container with id 3c512ece6ea37b2b36ba8165c95ea35542eba46dc46d70f2083dabc24350a853
Sep 11 16:25:03.120288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:03.120240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-a760b7" event={"ID":"9b049d60-2167-4693-b365-c1ef3ee3c4c7","Type":"ContainerStarted","Data":"db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a"}
Sep 11 16:25:03.120288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:03.120286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-a760b7" event={"ID":"9b049d60-2167-4693-b365-c1ef3ee3c4c7","Type":"ContainerStarted","Data":"3c512ece6ea37b2b36ba8165c95ea35542eba46dc46d70f2083dabc24350a853"}
Sep 11 16:25:03.144669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:03.144614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7592-a760b7" podStartSLOduration=1.144595805 podStartE2EDuration="1.144595805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:25:03.140414159 +0000 UTC m=+1373.402660301" watchObservedRunningTime="2026-09-11 16:25:03.144595805 +0000 UTC m=+1373.406841947"
Sep 11 16:25:03.817239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:03.817200    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7592-a760b7"]
Sep 11 16:25:03.821677 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:03.821639    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7592-a760b7"]
Sep 11 16:25:04.127134 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:25:04.127048    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7592-a760b7" container="test-curl-7592-a760b7"
Sep 11 16:25:04.896462 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:04.896413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:04.972815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:04.972774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:05.134594 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:05.134553    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7592-a760b7" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" containerName="test-curl-7592-a760b7" containerID="cri-o://db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a" gracePeriod=2
Sep 11 16:25:05.147545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:05.147423    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:25:05.167832 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:05.167776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:05.513952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:05.513918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:06.220317 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:06.220278    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:25:06.281586 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:06.281537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:07.337397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:07.337368    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:07.505964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:07.505842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgvgc\" (UniqueName: \"kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc\") pod \"9b049d60-2167-4693-b365-c1ef3ee3c4c7\" (UID: \"9b049d60-2167-4693-b365-c1ef3ee3c4c7\") "
Sep 11 16:25:07.508065 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:07.508043    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc" (OuterVolumeSpecName: "kube-api-access-mgvgc") pod "9b049d60-2167-4693-b365-c1ef3ee3c4c7" (UID: "9b049d60-2167-4693-b365-c1ef3ee3c4c7"). InnerVolumeSpecName "kube-api-access-mgvgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:25:07.607055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:07.607016    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgvgc\" (UniqueName: \"kubernetes.io/projected/9b049d60-2167-4693-b365-c1ef3ee3c4c7-kube-api-access-mgvgc\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:08.154018 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.153983    2564 generic.go:356] "Generic (PLEG): container finished" podID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" containerID="db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a" exitCode=137
Sep 11 16:25:08.154018 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.154033    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:08.154300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.154086    2564 scope.go:117] "RemoveContainer" containerID="db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a"
Sep 11 16:25:08.164716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.164692    2564 scope.go:117] "RemoveContainer" containerID="db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a"
Sep 11 16:25:08.165052 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:25:08.165034    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a\": container with ID starting with db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a not found: ID does not exist" containerID="db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a"
Sep 11 16:25:08.165126 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.165066    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a"} err="failed to get container status \"db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a\": rpc error: code = NotFound desc = could not find container \"db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a\": container with ID starting with db5f3c4da0c9df02ae0146b2ecd53a8dd451af23bb18232e2412aca35345f35a not found: ID does not exist"
Sep 11 16:25:08.171231 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:25:08.171204    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-a760b7\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" pod="opendatahub/test-curl-7592-a760b7"
Sep 11 16:25:08.286938 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.286907    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" path="/var/lib/kubelet/pods/9b049d60-2167-4693-b365-c1ef3ee3c4c7/volumes"
Sep 11 16:25:08.626732 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:08.626695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:25:13.011266 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:13.011229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:13.142153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:13.142124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:13.254187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:13.254143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:16.178288 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:16.178244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:20.168338 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.168291    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" podUID="f04bfac0-1989-4e04-8504-78fd7176d40d" containerName="main" containerID="cri-o://1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0" gracePeriod=45
Sep 11 16:25:20.437014 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.436987    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:25:20.531616 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.531793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.531793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531687    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.531793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531724    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.531793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531760    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.531968 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hk6r\" (UniqueName: \"kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r\") pod \"f04bfac0-1989-4e04-8504-78fd7176d40d\" (UID: \"f04bfac0-1989-4e04-8504-78fd7176d40d\") "
Sep 11 16:25:20.532025 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531958    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache" (OuterVolumeSpecName: "model-cache") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:20.532025 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531971    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home" (OuterVolumeSpecName: "home") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:20.532025 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.531983    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:20.532219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.532196    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:20.532219 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.532213    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:20.532336 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.532222    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:20.534010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.533988    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:25:20.534138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.534065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r" (OuterVolumeSpecName: "kube-api-access-6hk6r") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "kube-api-access-6hk6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:25:20.534138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.534102    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm" (OuterVolumeSpecName: "dshm") pod "f04bfac0-1989-4e04-8504-78fd7176d40d" (UID: "f04bfac0-1989-4e04-8504-78fd7176d40d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:20.633081 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.633050    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hk6r\" (UniqueName: \"kubernetes.io/projected/f04bfac0-1989-4e04-8504-78fd7176d40d-kube-api-access-6hk6r\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:20.633081 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.633075    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f04bfac0-1989-4e04-8504-78fd7176d40d-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:20.633081 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:20.633085    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f04bfac0-1989-4e04-8504-78fd7176d40d-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.237306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.237273    2564 generic.go:356] "Generic (PLEG): container finished" podID="f04bfac0-1989-4e04-8504-78fd7176d40d" containerID="1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0" exitCode=0
Sep 11 16:25:21.237826 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.237317    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"
Sep 11 16:25:21.237826 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.237356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" event={"ID":"f04bfac0-1989-4e04-8504-78fd7176d40d","Type":"ContainerDied","Data":"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"}
Sep 11 16:25:21.237826 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.237406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7" event={"ID":"f04bfac0-1989-4e04-8504-78fd7176d40d","Type":"ContainerDied","Data":"b8053e94da69028820d8e4657b6843b3c21b486c68657691a5f9c3df4aa66570"}
Sep 11 16:25:21.237826 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.237427    2564 scope.go:117] "RemoveContainer" containerID="1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"
Sep 11 16:25:21.240687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.240625    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" podUID="aa0d252e-2ff8-45f4-982d-966886594160" containerName="main" containerID="cri-o://fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba" gracePeriod=45
Sep 11 16:25:21.248951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.248931    2564 scope.go:117] "RemoveContainer" containerID="1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"
Sep 11 16:25:21.249315 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:25:21.249296    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0\": container with ID starting with 1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0 not found: ID does not exist" containerID="1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"
Sep 11 16:25:21.249416 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.249323    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0"} err="failed to get container status \"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0\": rpc error: code = NotFound desc = could not find container \"1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0\": container with ID starting with 1f05808df27c8ef0f2b8750080828d72d4f17ea683040434fe5142b38e825ad0 not found: ID does not exist"
Sep 11 16:25:21.270212 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.270186    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:25:21.280970 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.280932    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/auth-test-model-1ec6e6-kserve-6d5bc45f59-s2hv7"]
Sep 11 16:25:21.287101 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.287071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:25:21.497467 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.497403    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:25:21.543153 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543115    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543167    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7gcz\" (UniqueName: \"kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543416    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home" (OuterVolumeSpecName: "home") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:21.543479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache\") pod \"aa0d252e-2ff8-45f4-982d-966886594160\" (UID: \"aa0d252e-2ff8-45f4-982d-966886594160\") "
Sep 11 16:25:21.543749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:21.543749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:21.543924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543907    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.544010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543925    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.544010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.543935    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.545634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.545613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz" (OuterVolumeSpecName: "kube-api-access-m7gcz") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "kube-api-access-m7gcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:25:21.545738 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.545715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm" (OuterVolumeSpecName: "dshm") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:21.545922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.545897    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa0d252e-2ff8-45f4-982d-966886594160" (UID: "aa0d252e-2ff8-45f4-982d-966886594160"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:25:21.644976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.644942    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0d252e-2ff8-45f4-982d-966886594160-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.644976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.644972    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0d252e-2ff8-45f4-982d-966886594160-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.645197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.644986    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7gcz\" (UniqueName: \"kubernetes.io/projected/aa0d252e-2ff8-45f4-982d-966886594160-kube-api-access-m7gcz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:25:21.901999 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.901964    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:25:21.902395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902381    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" containerName="test-curl-7592-a760b7"
Sep 11 16:25:21.902439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902400    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" containerName="test-curl-7592-a760b7"
Sep 11 16:25:21.902439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902412    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04bfac0-1989-4e04-8504-78fd7176d40d" containerName="main"
Sep 11 16:25:21.902439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902418    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04bfac0-1989-4e04-8504-78fd7176d40d" containerName="main"
Sep 11 16:25:21.902439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902435    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0d252e-2ff8-45f4-982d-966886594160" containerName="main"
Sep 11 16:25:21.902439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902441    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0d252e-2ff8-45f4-982d-966886594160" containerName="main"
Sep 11 16:25:21.902617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902535    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b049d60-2167-4693-b365-c1ef3ee3c4c7" containerName="test-curl-7592-a760b7"
Sep 11 16:25:21.902617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902550    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0d252e-2ff8-45f4-982d-966886594160" containerName="main"
Sep 11 16:25:21.902617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.902560    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04bfac0-1989-4e04-8504-78fd7176d40d" containerName="main"
Sep 11 16:25:21.905744 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.905725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.913310 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.913288    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"kube-root-ca.crt\""
Sep 11 16:25:21.913433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.913288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"default-dockercfg-sljwk\""
Sep 11 16:25:21.913433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.913288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"sub-test-model-1ec6e6-kserve-self-signed-certs\""
Sep 11 16:25:21.919749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.919727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"openshift-service-ca.crt\""
Sep 11 16:25:21.922899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.922876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:25:21.947187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.947366 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.947366 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.947465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.947465 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.947564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.947476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgnqg\" (UniqueName: \"kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:21.967801 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:21.967768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:22.048320 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgnqg\" (UniqueName: \"kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048564 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.048964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.049021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.048976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.050882 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.050861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.051023 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.051005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.058845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.058825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgnqg\" (UniqueName: \"kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg\") pod \"sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.216272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.216179    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:22.245461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.245430    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa0d252e-2ff8-45f4-982d-966886594160" containerID="fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba" exitCode=0
Sep 11 16:25:22.245915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.245480    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"
Sep 11 16:25:22.245915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.245514    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" event={"ID":"aa0d252e-2ff8-45f4-982d-966886594160","Type":"ContainerDied","Data":"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"}
Sep 11 16:25:22.245915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.245601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl" event={"ID":"aa0d252e-2ff8-45f4-982d-966886594160","Type":"ContainerDied","Data":"6c7123398cef524880cae074dcbeb9b5187312ed059cecdd5c6587bee753e624"}
Sep 11 16:25:22.245915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.245627    2564 scope.go:117] "RemoveContainer" containerID="fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"
Sep 11 16:25:22.270848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.270726    2564 scope.go:117] "RemoveContainer" containerID="fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"
Sep 11 16:25:22.272715 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:25:22.272117    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba\": container with ID starting with fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba not found: ID does not exist" containerID="fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"
Sep 11 16:25:22.272715 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.272158    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba"} err="failed to get container status \"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba\": rpc error: code = NotFound desc = could not find container \"fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba\": container with ID starting with fee2417cf2ed133ba1204c5edbc17956850693cef0203866251e8f6498c43eba not found: ID does not exist"
Sep 11 16:25:22.289951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.289919    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04bfac0-1989-4e04-8504-78fd7176d40d" path="/var/lib/kubelet/pods/f04bfac0-1989-4e04-8504-78fd7176d40d/volumes"
Sep 11 16:25:22.290220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.290205    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:25:22.294295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.294259    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/auth-test-model-233d22-kserve-7d4d9fd879-xrccl"]
Sep 11 16:25:22.500237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:22.500207    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:25:22.500894 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:25:22.500866    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49502b22_cbc4_48ec_925c_10a1dd8e4f48.slice/crio-eb15ec455275a1f44da2751ef69326a862c7945d72e010b139cd2541ba0095fd WatchSource:0}: Error finding container eb15ec455275a1f44da2751ef69326a862c7945d72e010b139cd2541ba0095fd: Status 404 returned error can't find the container with id eb15ec455275a1f44da2751ef69326a862c7945d72e010b139cd2541ba0095fd
Sep 11 16:25:23.255441 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:23.255402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" event={"ID":"49502b22-cbc4-48ec-925c-10a1dd8e4f48","Type":"ContainerStarted","Data":"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"}
Sep 11 16:25:23.255961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:23.255452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" event={"ID":"49502b22-cbc4-48ec-925c-10a1dd8e4f48","Type":"ContainerStarted","Data":"eb15ec455275a1f44da2751ef69326a862c7945d72e010b139cd2541ba0095fd"}
Sep 11 16:25:23.279930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:23.279879    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" podStartSLOduration=2.279862783 podStartE2EDuration="2.279862783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:25:23.27640906 +0000 UTC m=+1393.538655201" watchObservedRunningTime="2026-09-11 16:25:23.279862783 +0000 UTC m=+1393.542108927"
Sep 11 16:25:23.718674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:23.718640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:23.945734 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:23.945701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:24.291285 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:24.291246    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa0d252e-2ff8-45f4-982d-966886594160" path="/var/lib/kubelet/pods/aa0d252e-2ff8-45f4-982d-966886594160/volumes"
Sep 11 16:25:31.882182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:31.882128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:25:32.216929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:32.216833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:32.216929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:32.216886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:32.229346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:32.229314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:32.321587 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:32.321561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:25:36.417192 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:36.417161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:44.812392 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:44.812349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:51.405973 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.405924    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:25:51.409505 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.409480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.412939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.412917    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"openshift-service-ca.crt\""
Sep 11 16:25:51.451160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87zr\" (UniqueName: \"kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.451356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.451356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.451356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.451356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.451637 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.451368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.452577 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.452554    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:25:51.471325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.471295    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"sub-test-model-233d22-kserve-self-signed-certs\""
Sep 11 16:25:51.471965 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.471934    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"default-dockercfg-t75gx\""
Sep 11 16:25:51.472125 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.471966    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"kube-root-ca.crt\""
Sep 11 16:25:51.552739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.552959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.552959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87zr\" (UniqueName: \"kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.552959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.552959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.552959 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.552936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.553436 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.553405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.553546 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.553498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.553629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.553570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.556106 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.556081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.556315 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.556292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.578935 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.578905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87zr\" (UniqueName: \"kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr\") pod \"sub-test-model-233d22-kserve-7d466d8995-98mrr\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") " pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.719602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.719469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:25:51.939127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:51.939069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:52.004649 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.004623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:25:52.007242 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:25:52.007218    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5301d19d_ecdc_48df_b043_22c7084e5b40.slice/crio-d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9 WatchSource:0}: Error finding container d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9: Status 404 returned error can't find the container with id d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9
Sep 11 16:25:52.222832 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.222801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:52.426146 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.426108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" event={"ID":"5301d19d-ecdc-48df-b043-22c7084e5b40","Type":"ContainerStarted","Data":"bef9e51eee376b667e5af7e326dd68802ea106c8211be79e9ac22380db84fb80"}
Sep 11 16:25:52.426617 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.426164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" event={"ID":"5301d19d-ecdc-48df-b043-22c7084e5b40","Type":"ContainerStarted","Data":"d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9"}
Sep 11 16:25:52.461225 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.461177    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" podStartSLOduration=1.461160223 podStartE2EDuration="1.461160223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:25:52.45868724 +0000 UTC m=+1422.720933383" watchObservedRunningTime="2026-09-11 16:25:52.461160223 +0000 UTC m=+1422.723406367"
Sep 11 16:25:52.916434 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:52.916399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:53.063402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:53.063364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:53.176663 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:53.176578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:55.448323 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:55.448291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:55.970697 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:55.970664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:56.104369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:56.104337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:56.472407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:56.472373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:25:57.200106 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:57.200071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:25:57.917886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:25:57.917843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:00.152664 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:00.152627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:01.192578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:01.192473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:01.720198 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:01.720157    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:26:01.720370 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:01.720216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:26:01.733076 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:01.733050    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:26:02.497093 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:02.497060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:26:02.745037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:02.744999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:03.012778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:03.012751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:03.619418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:03.619388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:03.748514 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:03.748473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:19.478750 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:19.478709    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:26:25.658949 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:25.658917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:26.065031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:26.064998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:26.540031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:26.539983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:26.634813 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:26.634777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:26.899500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:26.899401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:27.368746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:27.368715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:27.760017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:27.759983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:28.764801 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:28.764763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:29.721077 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:29.721035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:30.320383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:30.320350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:30.491295 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:30.491256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:30.912676 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:30.912648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:31.766899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.766865    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:26:31.771778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.771756    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.774931 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.774908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4336c5-serving-cert\""
Sep 11 16:26:31.784334 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.784309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:26:31.815828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.815778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:31.852072 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.852040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.852072 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.852074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2mqs\" (UniqueName: \"kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.852292 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.852093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.852292 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.852255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.894089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.894057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:31.953774 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.953736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.953963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.953802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.953963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.953826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2mqs\" (UniqueName: \"kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.953963 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.953841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.954143 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:31.953974    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-serving-cert: secret "maas-api-e2e-api-b-4336c5-serving-cert" not found
Sep 11 16:26:31.954143 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:31.954035    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls podName:2568f093-33f4-408e-8eec-60361d5e27e3 nodeName:}" failed. No retries permitted until 2026-09-11 16:26:32.454016098 +0000 UTC m=+1462.716262220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls") pod "maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" (UID: "2568f093-33f4-408e-8eec-60361d5e27e3") : secret "maas-api-e2e-api-b-4336c5-serving-cert" not found
Sep 11 16:26:31.954578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.954558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.956543 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.956486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:31.962839 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:31.962817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2mqs\" (UniqueName: \"kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:32.110001 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.109893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:32.293188 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.293157    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:26:32.322600 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.322559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:32.412078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.411992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:32.459002 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.458974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:32.461645 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.461625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") pod \"maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:32.686241 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.686149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:32.970267 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.970243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:26:32.973147 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:26:32.973118    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2568f093_33f4_408e_8eec_60361d5e27e3.slice/crio-0cf1d06437ad94b420c740b022b43b1c22fb170beaa017b1830650c6297adb1a WatchSource:0}: Error finding container 0cf1d06437ad94b420c740b022b43b1c22fb170beaa017b1830650c6297adb1a: Status 404 returned error can't find the container with id 0cf1d06437ad94b420c740b022b43b1c22fb170beaa017b1830650c6297adb1a
Sep 11 16:26:32.974730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.974707    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:26:32.991707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:32.991661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:33.677353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:33.677249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" event={"ID":"2568f093-33f4-408e-8eec-60361d5e27e3","Type":"ContainerStarted","Data":"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"}
Sep 11 16:26:33.677353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:33.677321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:33.677353 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:33.677344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" event={"ID":"2568f093-33f4-408e-8eec-60361d5e27e3","Type":"ContainerStarted","Data":"0cf1d06437ad94b420c740b022b43b1c22fb170beaa017b1830650c6297adb1a"}
Sep 11 16:26:33.699550 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:33.699446    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" podStartSLOduration=2.387466227 podStartE2EDuration="2.69943007s" totalImagesPullingTime="311.963843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:33.697240213 +0000 UTC m=+1463.959486356" watchObservedRunningTime="2026-09-11 16:26:33.69943007 +0000 UTC m=+1463.961676242"
Sep 11 16:26:33.915775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:33.915736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:34.819397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:34.819364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:35.656479 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:35.656434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:36.550316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:36.550287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:39.688190 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:39.688163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:26:46.189555 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.189510    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7592-f3daed"]
Sep 11 16:26:46.193122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.193106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:46.196045 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.196022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xwld7\""
Sep 11 16:26:46.198787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.198764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-f3daed"]
Sep 11 16:26:46.301407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.301365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrzfk\" (UniqueName: \"kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk\") pod \"test-curl-7592-f3daed\" (UID: \"d3b11c9d-ac2b-48db-a37f-f40a03c377d1\") " pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:46.402786 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.402745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrzfk\" (UniqueName: \"kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk\") pod \"test-curl-7592-f3daed\" (UID: \"d3b11c9d-ac2b-48db-a37f-f40a03c377d1\") " pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:46.412971 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.412948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrzfk\" (UniqueName: \"kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk\") pod \"test-curl-7592-f3daed\" (UID: \"d3b11c9d-ac2b-48db-a37f-f40a03c377d1\") " pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:46.503537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.503416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:46.777787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:46.777763    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-f3daed"]
Sep 11 16:26:46.779397 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:26:46.779364    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3b11c9d_ac2b_48db_a37f_f40a03c377d1.slice/crio-bb25f679146104aa9190d84cf94fea58f87adf2df46f6efb22711fc0c55cd0d4 WatchSource:0}: Error finding container bb25f679146104aa9190d84cf94fea58f87adf2df46f6efb22711fc0c55cd0d4: Status 404 returned error can't find the container with id bb25f679146104aa9190d84cf94fea58f87adf2df46f6efb22711fc0c55cd0d4
Sep 11 16:26:47.763595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:47.763561    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-f3daed" event={"ID":"d3b11c9d-ac2b-48db-a37f-f40a03c377d1","Type":"ContainerStarted","Data":"08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b"}
Sep 11 16:26:47.764130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:47.763604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-f3daed" event={"ID":"d3b11c9d-ac2b-48db-a37f-f40a03c377d1","Type":"ContainerStarted","Data":"bb25f679146104aa9190d84cf94fea58f87adf2df46f6efb22711fc0c55cd0d4"}
Sep 11 16:26:47.783142 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:47.783087    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7592-f3daed" podStartSLOduration=1.783071498 podStartE2EDuration="1.783071498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:47.779907914 +0000 UTC m=+1478.042154060" watchObservedRunningTime="2026-09-11 16:26:47.783071498 +0000 UTC m=+1478.045317634"
Sep 11 16:26:48.383861 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.383824    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7592-f3daed"]
Sep 11 16:26:48.388449 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.388418    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7592-f3daed"]
Sep 11 16:26:48.506924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.506894    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7592-dbda07"]
Sep 11 16:26:48.507318 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.507306    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" containerName="test-curl-7592-f3daed"
Sep 11 16:26:48.507360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.507320    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" containerName="test-curl-7592-f3daed"
Sep 11 16:26:48.507395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.507386    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" containerName="test-curl-7592-f3daed"
Sep 11 16:26:48.510426 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.510409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:48.517461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.517435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-dbda07"]
Sep 11 16:26:48.626872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.626835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4pq\" (UniqueName: \"kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq\") pod \"test-curl-7592-dbda07\" (UID: \"5484e68e-5e8f-4b41-8ce0-613f148a96a0\") " pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:48.728624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.728591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4pq\" (UniqueName: \"kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq\") pod \"test-curl-7592-dbda07\" (UID: \"5484e68e-5e8f-4b41-8ce0-613f148a96a0\") " pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:48.740823 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.740787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4pq\" (UniqueName: \"kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq\") pod \"test-curl-7592-dbda07\" (UID: \"5484e68e-5e8f-4b41-8ce0-613f148a96a0\") " pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:48.770851 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:48.770762    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7592-f3daed" container="test-curl-7592-f3daed"
Sep 11 16:26:48.821919 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:48.821884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:49.099758 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:49.099731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7592-dbda07"]
Sep 11 16:26:49.101016 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:26:49.100989    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5484e68e_5e8f_4b41_8ce0_613f148a96a0.slice/crio-6fa1213676090da2c7230beebbee5d15878cc1b65269907cea8180960cfe0dec WatchSource:0}: Error finding container 6fa1213676090da2c7230beebbee5d15878cc1b65269907cea8180960cfe0dec: Status 404 returned error can't find the container with id 6fa1213676090da2c7230beebbee5d15878cc1b65269907cea8180960cfe0dec
Sep 11 16:26:49.778771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:49.778732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-dbda07" event={"ID":"5484e68e-5e8f-4b41-8ce0-613f148a96a0","Type":"ContainerStarted","Data":"4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2"}
Sep 11 16:26:49.779227 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:49.778780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7592-dbda07" event={"ID":"5484e68e-5e8f-4b41-8ce0-613f148a96a0","Type":"ContainerStarted","Data":"6fa1213676090da2c7230beebbee5d15878cc1b65269907cea8180960cfe0dec"}
Sep 11 16:26:49.779227 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:49.778816    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7592-f3daed" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" containerName="test-curl-7592-f3daed" containerID="cri-o://08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b" gracePeriod=2
Sep 11 16:26:49.797607 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:49.797560    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-f3daed\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:49.798499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:49.798456    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7592-dbda07" podStartSLOduration=1.798441036 podStartE2EDuration="1.798441036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:49.795195123 +0000 UTC m=+1480.057441265" watchObservedRunningTime="2026-09-11 16:26:49.798441036 +0000 UTC m=+1480.060687202"
Sep 11 16:26:49.799627 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:49.799599    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-f3daed\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:50.285890 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:50.285854    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-f3daed\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:50.406384 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:50.406352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7592-dbda07"]
Sep 11 16:26:50.413253 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:50.413225    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7592-dbda07"]
Sep 11 16:26:50.784363 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:50.784332    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7592-dbda07" container="test-curl-7592-dbda07"
Sep 11 16:26:51.202571 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:51.202455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:51.792263 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:51.792199    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7592-dbda07" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" containerName="test-curl-7592-dbda07" containerID="cri-o://4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2" gracePeriod=2
Sep 11 16:26:51.794941 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:51.794907    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-dbda07\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:51.976975 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:51.976947    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:51.979673 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:51.979640    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7592-dbda07\" is forbidden: User \"system:node:ip-10-0-137-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-9.ec2.internal' and this object" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:52.061508 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.061424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrzfk\" (UniqueName: \"kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk\") pod \"d3b11c9d-ac2b-48db-a37f-f40a03c377d1\" (UID: \"d3b11c9d-ac2b-48db-a37f-f40a03c377d1\") "
Sep 11 16:26:52.063624 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.063598    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk" (OuterVolumeSpecName: "kube-api-access-lrzfk") pod "d3b11c9d-ac2b-48db-a37f-f40a03c377d1" (UID: "d3b11c9d-ac2b-48db-a37f-f40a03c377d1"). InnerVolumeSpecName "kube-api-access-lrzfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:26:52.162846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.162801    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrzfk\" (UniqueName: \"kubernetes.io/projected/d3b11c9d-ac2b-48db-a37f-f40a03c377d1-kube-api-access-lrzfk\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:26:52.287052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.287017    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" path="/var/lib/kubelet/pods/d3b11c9d-ac2b-48db-a37f-f40a03c377d1/volumes"
Sep 11 16:26:52.776911 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.776866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:52.799373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.799339    2564 generic.go:356] "Generic (PLEG): container finished" podID="d3b11c9d-ac2b-48db-a37f-f40a03c377d1" containerID="08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b" exitCode=137
Sep 11 16:26:52.799373 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.799379    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-f3daed"
Sep 11 16:26:52.799883 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.799411    2564 scope.go:117] "RemoveContainer" containerID="08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b"
Sep 11 16:26:52.809080 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.809053    2564 scope.go:117] "RemoveContainer" containerID="08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b"
Sep 11 16:26:52.809411 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:52.809387    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b\": container with ID starting with 08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b not found: ID does not exist" containerID="08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b"
Sep 11 16:26:52.809469 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:52.809422    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b"} err="failed to get container status \"08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b\": rpc error: code = NotFound desc = could not find container \"08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b\": container with ID starting with 08efc4b6e32e082ec9bcb4fbb9609d22635235cfe8744e25df74382cc5d23f7b not found: ID does not exist"
Sep 11 16:26:53.501274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:53.501243    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:26:53.517173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:53.517143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:53.582676 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:53.582641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:26:53.983128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:53.983103    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:54.084046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.083937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw4pq\" (UniqueName: \"kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq\") pod \"5484e68e-5e8f-4b41-8ce0-613f148a96a0\" (UID: \"5484e68e-5e8f-4b41-8ce0-613f148a96a0\") "
Sep 11 16:26:54.086306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.086270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq" (OuterVolumeSpecName: "kube-api-access-nw4pq") pod "5484e68e-5e8f-4b41-8ce0-613f148a96a0" (UID: "5484e68e-5e8f-4b41-8ce0-613f148a96a0"). InnerVolumeSpecName "kube-api-access-nw4pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:26:54.185400 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.185360    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw4pq\" (UniqueName: \"kubernetes.io/projected/5484e68e-5e8f-4b41-8ce0-613f148a96a0-kube-api-access-nw4pq\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:26:54.286977 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.286941    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" path="/var/lib/kubelet/pods/5484e68e-5e8f-4b41-8ce0-613f148a96a0/volumes"
Sep 11 16:26:54.357776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.357670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:54.672087 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.671983    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:26:54.680923 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.680887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:54.813177 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.813143    2564 generic.go:356] "Generic (PLEG): container finished" podID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" containerID="4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2" exitCode=137
Sep 11 16:26:54.813358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.813206    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7592-dbda07"
Sep 11 16:26:54.813358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.813249    2564 scope.go:117] "RemoveContainer" containerID="4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2"
Sep 11 16:26:54.822768 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.822741    2564 scope.go:117] "RemoveContainer" containerID="4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2"
Sep 11 16:26:54.823097 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:26:54.823078    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2\": container with ID starting with 4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2 not found: ID does not exist" containerID="4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2"
Sep 11 16:26:54.823176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:54.823111    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2"} err="failed to get container status \"4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2\": rpc error: code = NotFound desc = could not find container \"4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2\": container with ID starting with 4f4938fd74068af097d23cdc22727d4cbad5ee45b0841ab9e7da4203977217d2 not found: ID does not exist"
Sep 11 16:26:55.137708 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:55.137676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:55.238536 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:55.238487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:56.034405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:56.034369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:57.175874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:57.175841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:58.266903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:58.266866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:26:59.478706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:26:59.478675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:00.327709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:00.327671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:01.060758 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:01.060721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:01.926769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:01.926724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:02.708442 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:02.708411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:03.475900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.475863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:03.576593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.576558    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:27:03.576972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.576960    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" containerName="test-curl-7592-dbda07"
Sep 11 16:27:03.577019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.576974    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" containerName="test-curl-7592-dbda07"
Sep 11 16:27:03.577062 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.577057    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5484e68e-5e8f-4b41-8ce0-613f148a96a0" containerName="test-curl-7592-dbda07"
Sep 11 16:27:03.580155 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.580127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.583499 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.583477    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-1ec6e6\"/\"rate-test-model-1ec6e6-kserve-self-signed-certs\""
Sep 11 16:27:03.594414 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.594387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:27:03.683401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.683671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbhpj\" (UniqueName: \"kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.683671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.683671 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.683903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.683903 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.683739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.740691 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.740605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:03.784858 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.784815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.784858 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.784865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.784930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.784964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbhpj\" (UniqueName: \"kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.785016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785122 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.785051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.785238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785356 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.785276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.785456 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.785381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.787579 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.787558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.787802 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.787782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.794453 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.794421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbhpj\" (UniqueName: \"kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj\") pod \"rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") " pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:03.890018 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:03.889983    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:04.170904 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:04.170854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:27:04.172242 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:27:04.172213    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d6d35e2_0027_41fc_b3ac_dc5cb845ee8e.slice/crio-27e9d530f561e28f2ba6e7651d97db384aef85569e90303b5ab17b9be28d0c26 WatchSource:0}: Error finding container 27e9d530f561e28f2ba6e7651d97db384aef85569e90303b5ab17b9be28d0c26: Status 404 returned error can't find the container with id 27e9d530f561e28f2ba6e7651d97db384aef85569e90303b5ab17b9be28d0c26
Sep 11 16:27:04.341732 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:04.341681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:04.885578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:04.885495    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" event={"ID":"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e","Type":"ContainerStarted","Data":"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"}
Sep 11 16:27:04.885578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:04.885571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" event={"ID":"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e","Type":"ContainerStarted","Data":"27e9d530f561e28f2ba6e7651d97db384aef85569e90303b5ab17b9be28d0c26"}
Sep 11 16:27:04.915805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:04.915742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" podStartSLOduration=1.9157260329999999 podStartE2EDuration="1.915726033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:27:04.913449327 +0000 UTC m=+1495.175695468" watchObservedRunningTime="2026-09-11 16:27:04.915726033 +0000 UTC m=+1495.177972174"
Sep 11 16:27:07.974223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:07.974182    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:27:08.277329 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.277303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:08.521613 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.521553    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" podUID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" containerName="main" containerID="cri-o://81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e" gracePeriod=45
Sep 11 16:27:08.777319 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.777289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:27:08.825745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.825745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825687    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.825745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.826049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgnqg\" (UniqueName: \"kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.826049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.826049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs\") pod \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\" (UID: \"49502b22-cbc4-48ec-925c-10a1dd8e4f48\") "
Sep 11 16:27:08.826049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825977    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:08.826049 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.825984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache" (OuterVolumeSpecName: "model-cache") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:08.826332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.826143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home" (OuterVolumeSpecName: "home") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:08.826332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.826292    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.826332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.826312    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.826332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.826327    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.828132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.828106    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm" (OuterVolumeSpecName: "dshm") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:08.828289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.828178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:27:08.828289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.828265    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg" (OuterVolumeSpecName: "kube-api-access-jgnqg") pod "49502b22-cbc4-48ec-925c-10a1dd8e4f48" (UID: "49502b22-cbc4-48ec-925c-10a1dd8e4f48"). InnerVolumeSpecName "kube-api-access-jgnqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:08.910716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.910680    2564 generic.go:356] "Generic (PLEG): container finished" podID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" containerID="81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e" exitCode=0
Sep 11 16:27:08.910863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.910730    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"
Sep 11 16:27:08.910863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.910764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" event={"ID":"49502b22-cbc4-48ec-925c-10a1dd8e4f48","Type":"ContainerDied","Data":"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"}
Sep 11 16:27:08.910863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.910810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn" event={"ID":"49502b22-cbc4-48ec-925c-10a1dd8e4f48","Type":"ContainerDied","Data":"eb15ec455275a1f44da2751ef69326a862c7945d72e010b139cd2541ba0095fd"}
Sep 11 16:27:08.910863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.910833    2564 scope.go:117] "RemoveContainer" containerID="81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"
Sep 11 16:27:08.920953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.920934    2564 scope.go:117] "RemoveContainer" containerID="81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"
Sep 11 16:27:08.921236 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:27:08.921214    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e\": container with ID starting with 81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e not found: ID does not exist" containerID="81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"
Sep 11 16:27:08.921290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.921247    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e"} err="failed to get container status \"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e\": rpc error: code = NotFound desc = could not find container \"81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e\": container with ID starting with 81cab0cdbaaf3c8b4c50114d06f5c32f0d9e92cc0580ad8b9483f39c3b73be0e not found: ID does not exist"
Sep 11 16:27:08.926907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.926885    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49502b22-cbc4-48ec-925c-10a1dd8e4f48-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.926907 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.926908    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49502b22-cbc4-48ec-925c-10a1dd8e4f48-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.927037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.926918    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgnqg\" (UniqueName: \"kubernetes.io/projected/49502b22-cbc4-48ec-925c-10a1dd8e4f48-kube-api-access-jgnqg\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:08.943537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.943495    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:27:08.951630 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:08.951597    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/sub-test-model-1ec6e6-kserve-c844fbbc5-njxqn"]
Sep 11 16:27:09.694187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:09.694152    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" podUID="5301d19d-ecdc-48df-b043-22c7084e5b40" containerName="main" containerID="cri-o://bef9e51eee376b667e5af7e326dd68802ea106c8211be79e9ac22380db84fb80" gracePeriod=45
Sep 11 16:27:09.920468 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:09.920438    2564 generic.go:356] "Generic (PLEG): container finished" podID="5301d19d-ecdc-48df-b043-22c7084e5b40" containerID="bef9e51eee376b667e5af7e326dd68802ea106c8211be79e9ac22380db84fb80" exitCode=0
Sep 11 16:27:09.920646 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:09.920496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" event={"ID":"5301d19d-ecdc-48df-b043-22c7084e5b40","Type":"ContainerDied","Data":"bef9e51eee376b667e5af7e326dd68802ea106c8211be79e9ac22380db84fb80"}
Sep 11 16:27:09.945111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:09.945044    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:27:10.034709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.034709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034712    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.034972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034742    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r87zr\" (UniqueName: \"kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.034972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.034972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034786    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.034972 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.034909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir\") pod \"5301d19d-ecdc-48df-b043-22c7084e5b40\" (UID: \"5301d19d-ecdc-48df-b043-22c7084e5b40\") "
Sep 11 16:27:10.035189 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home" (OuterVolumeSpecName: "home") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:10.035189 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache" (OuterVolumeSpecName: "model-cache") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:10.035189 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035159    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:10.035378 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035363    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.035420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035385    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.035420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.035400    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.037180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.037144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:27:10.037180 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.037174    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr" (OuterVolumeSpecName: "kube-api-access-r87zr") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "kube-api-access-r87zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:10.037346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.037219    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm" (OuterVolumeSpecName: "dshm") pod "5301d19d-ecdc-48df-b043-22c7084e5b40" (UID: "5301d19d-ecdc-48df-b043-22c7084e5b40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:10.136315 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.136264    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5301d19d-ecdc-48df-b043-22c7084e5b40-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.136510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.136339    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r87zr\" (UniqueName: \"kubernetes.io/projected/5301d19d-ecdc-48df-b043-22c7084e5b40-kube-api-access-r87zr\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.136510 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.136355    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5301d19d-ecdc-48df-b043-22c7084e5b40-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:10.288273 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.288240    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" path="/var/lib/kubelet/pods/49502b22-cbc4-48ec-925c-10a1dd8e4f48/volumes"
Sep 11 16:27:10.311556 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:27:10.311503    2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5301d19d_ecdc_48df_b043_22c7084e5b40.slice/crio-d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9\": RecentStats: unable to find data in memory cache]"
Sep 11 16:27:10.347235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.347206    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:27:10.356120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.356094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:27:10.361415 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.361378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:10.927847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.927821    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"
Sep 11 16:27:10.927847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.927837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr" event={"ID":"5301d19d-ecdc-48df-b043-22c7084e5b40","Type":"ContainerDied","Data":"d9869632e57ff47b4d37ac61c147176f0f935d77fde052d6b4ba1a2cd4f485c9"}
Sep 11 16:27:10.928340 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.927880    2564 scope.go:117] "RemoveContainer" containerID="bef9e51eee376b667e5af7e326dd68802ea106c8211be79e9ac22380db84fb80"
Sep 11 16:27:10.960695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.960658    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:27:10.965042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:10.965003    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/sub-test-model-233d22-kserve-7d466d8995-98mrr"]
Sep 11 16:27:11.513055 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:11.513020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:12.288307 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:12.288275    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5301d19d-ecdc-48df-b043-22c7084e5b40" path="/var/lib/kubelet/pods/5301d19d-ecdc-48df-b043-22c7084e5b40/volumes"
Sep 11 16:27:13.890494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:13.890456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:13.890989 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:13.890538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:13.903213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:13.903178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:13.958255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:13.958221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:27:14.190205 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.190104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:14.291951 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.291912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:14.391279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.391238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:14.492196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.492103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:14.761623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.761591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:14.862745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:14.862711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:15.733403 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:15.733372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:16.484390 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:16.484355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:17.281181 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:17.281143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:18.145920 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:18.145884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:19.300990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:19.300955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:20.891780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:20.891739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:21.015962 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:21.015927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:21.256120 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:21.256041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:21.853857 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:21.853817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:22.759001 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:22.758969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:24.364816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:24.364777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:24.505316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:24.505282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:25.180301 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:25.180219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:26.052031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:26.051986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:26.963380 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:26.963349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:27.076894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:27.076856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:27:27.777404 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:27.777364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.149477 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.149394    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:27:37.150031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.149696    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" podUID="2568f093-33f4-408e-8eec-60361d5e27e3" containerName="maas-api" containerID="cri-o://7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb" gracePeriod=30
Sep 11 16:27:37.181749 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.181723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.262046 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.262009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.363698 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.363667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.394578 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.394549    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:27:37.463840 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.463746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.521252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.521216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2mqs\" (UniqueName: \"kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs\") pod \"2568f093-33f4-408e-8eec-60361d5e27e3\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") "
Sep 11 16:27:37.521421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.521327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") pod \"2568f093-33f4-408e-8eec-60361d5e27e3\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") "
Sep 11 16:27:37.521421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.521385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs\") pod \"2568f093-33f4-408e-8eec-60361d5e27e3\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") "
Sep 11 16:27:37.521421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.521402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca\") pod \"2568f093-33f4-408e-8eec-60361d5e27e3\" (UID: \"2568f093-33f4-408e-8eec-60361d5e27e3\") "
Sep 11 16:27:37.521810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.521783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2568f093-33f4-408e-8eec-60361d5e27e3" (UID: "2568f093-33f4-408e-8eec-60361d5e27e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:37.523599 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.523574    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2568f093-33f4-408e-8eec-60361d5e27e3" (UID: "2568f093-33f4-408e-8eec-60361d5e27e3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:27:37.523730 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.523617    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs" (OuterVolumeSpecName: "kube-api-access-t2mqs") pod "2568f093-33f4-408e-8eec-60361d5e27e3" (UID: "2568f093-33f4-408e-8eec-60361d5e27e3"). InnerVolumeSpecName "kube-api-access-t2mqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:37.523902 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.523870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2568f093-33f4-408e-8eec-60361d5e27e3" (UID: "2568f093-33f4-408e-8eec-60361d5e27e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:27:37.622444 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.622411    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:37.622444 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.622441    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2568f093-33f4-408e-8eec-60361d5e27e3-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:37.622444 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.622451    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2mqs\" (UniqueName: \"kubernetes.io/projected/2568f093-33f4-408e-8eec-60361d5e27e3-kube-api-access-t2mqs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:37.622706 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.622461    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2568f093-33f4-408e-8eec-60361d5e27e3-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:27:37.777034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.776999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:37.876129 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:37.876094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:38.091709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.091626    2564 generic.go:356] "Generic (PLEG): container finished" podID="2568f093-33f4-408e-8eec-60361d5e27e3" containerID="7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb" exitCode=0
Sep 11 16:27:38.091709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.091669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"
Sep 11 16:27:38.091896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.091708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" event={"ID":"2568f093-33f4-408e-8eec-60361d5e27e3","Type":"ContainerDied","Data":"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"}
Sep 11 16:27:38.091896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.091763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r" event={"ID":"2568f093-33f4-408e-8eec-60361d5e27e3","Type":"ContainerDied","Data":"0cf1d06437ad94b420c740b022b43b1c22fb170beaa017b1830650c6297adb1a"}
Sep 11 16:27:38.091896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.091786    2564 scope.go:117] "RemoveContainer" containerID="7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"
Sep 11 16:27:38.109766 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.109744    2564 scope.go:117] "RemoveContainer" containerID="7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"
Sep 11 16:27:38.110095 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:27:38.110075    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb\": container with ID starting with 7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb not found: ID does not exist" containerID="7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"
Sep 11 16:27:38.110168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.110111    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb"} err="failed to get container status \"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb\": rpc error: code = NotFound desc = could not find container \"7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb\": container with ID starting with 7a56eec312dffa10c9a767c0a304596b5d7b3b1133a8cafd11449b27501788cb not found: ID does not exist"
Sep 11 16:27:38.121407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.121376    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:27:38.127239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.127217    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4336c5-75c8f67d6c-d478r"]
Sep 11 16:27:38.287483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.287451    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2568f093-33f4-408e-8eec-60361d5e27e3" path="/var/lib/kubelet/pods/2568f093-33f4-408e-8eec-60361d5e27e3/volumes"
Sep 11 16:27:38.985063 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:38.985033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:39.803030 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:39.802993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:40.593632 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:40.593595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:41.551174 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:41.551134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:41.878031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:41.877932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:27:43.637570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:43.637504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:43.739591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:43.739561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:43.903483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:43.903385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:44.454347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:44.454312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:45.416916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:45.416881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:46.251012 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:46.250971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:47.079939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:47.079895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:47.858456 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:47.858416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:48.638986 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:48.638953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:54.904331 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:54.904296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:54.975245 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:54.975209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:55.045279 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:55.045018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:55.112364 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:55.112326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:55.189407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:55.189311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:55.475358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:55.475266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:55.564030 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:55.563991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:56.410925 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:56.410894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:57.178850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:57.178815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:58.158242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:58.158211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:27:59.194282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:27:59.194243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:01.395760 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.395729    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:28:01.396182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396123    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" containerName="main"
Sep 11 16:28:01.396182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396135    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" containerName="main"
Sep 11 16:28:01.396182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5301d19d-ecdc-48df-b043-22c7084e5b40" containerName="main"
Sep 11 16:28:01.396182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396167    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5301d19d-ecdc-48df-b043-22c7084e5b40" containerName="main"
Sep 11 16:28:01.396363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396200    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2568f093-33f4-408e-8eec-60361d5e27e3" containerName="maas-api"
Sep 11 16:28:01.396363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396205    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2568f093-33f4-408e-8eec-60361d5e27e3" containerName="maas-api"
Sep 11 16:28:01.396363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396275    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2568f093-33f4-408e-8eec-60361d5e27e3" containerName="maas-api"
Sep 11 16:28:01.396363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396283    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5301d19d-ecdc-48df-b043-22c7084e5b40" containerName="main"
Sep 11 16:28:01.396363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.396290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="49502b22-cbc4-48ec-925c-10a1dd8e4f48" containerName="main"
Sep 11 16:28:01.399467 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.399447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.403665 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.403641    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"openshift-service-ca.crt\""
Sep 11 16:28:01.403789 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.403665    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"kube-root-ca.crt\""
Sep 11 16:28:01.403860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.403801    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"rate-test-model-233d22-kserve-self-signed-certs\""
Sep 11 16:28:01.403860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.403854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-233d22\"/\"default-dockercfg-t75gx\""
Sep 11 16:28:01.409367 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.409342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:28:01.435252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.435213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:01.465140 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.465314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.465314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzc6\" (UniqueName: \"kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.465314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.465314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.465314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.465294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566528 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzc6\" (UniqueName: \"kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566844 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.566844 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.567000 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.566978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.567150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.567132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.567228 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.567151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.569118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.569097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.569438 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.569423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.575485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.575464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzc6\" (UniqueName: \"kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6\") pod \"rate-test-model-233d22-kserve-5589664899-8fjmd\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") " pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.709687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.709602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:01.990927 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:01.990896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:28:01.992428 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:28:01.992402    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70d70ef3_faee_4a21_8da1_7d0a5a16afe1.slice/crio-e4d1171ae1bc5a7414ae925893487a88d677a12db252b6cb61049a201239a254 WatchSource:0}: Error finding container e4d1171ae1bc5a7414ae925893487a88d677a12db252b6cb61049a201239a254: Status 404 returned error can't find the container with id e4d1171ae1bc5a7414ae925893487a88d677a12db252b6cb61049a201239a254
Sep 11 16:28:02.086964 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.086924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:02.187159 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.187122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:02.233824 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.233786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" event={"ID":"70d70ef3-faee-4a21-8da1-7d0a5a16afe1","Type":"ContainerStarted","Data":"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"}
Sep 11 16:28:02.233824 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.233828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" event={"ID":"70d70ef3-faee-4a21-8da1-7d0a5a16afe1","Type":"ContainerStarted","Data":"e4d1171ae1bc5a7414ae925893487a88d677a12db252b6cb61049a201239a254"}
Sep 11 16:28:02.253143 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.253029    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" podStartSLOduration=1.253011782 podStartE2EDuration="1.253011782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:28:02.25190711 +0000 UTC m=+1552.514153269" watchObservedRunningTime="2026-09-11 16:28:02.253011782 +0000 UTC m=+1552.515257974"
Sep 11 16:28:02.324042 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.324005    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:28:02.324264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.324238    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" containerID="cri-o://6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f" gracePeriod=30
Sep 11 16:28:02.346860 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.346825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:02.942108 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:02.942070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:03.711642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:03.711610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:04.380572 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:04.380510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:04.451089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:04.451053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:04.596109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:04.596061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:05.281633 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:05.281602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:05.786092 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:05.786052    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:28:05.786471 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:05.786125    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:28:06.134934 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:06.134840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:07.585376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.585348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:28:07.729487 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729487 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729433    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729487 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729476    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729585    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729618    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7w9v\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729732    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.729818 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket\") pod \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\" (UID: \"54fa4747-cc45-4f21-a662-e23ebb6cba4c\") "
Sep 11 16:28:07.730132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.729949    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:07.730132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:07.730132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:07.730287 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:07.730287 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730264    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.730287 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730285    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.730642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730298    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.730642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730315    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.730642 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.730534    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:28:07.732166 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.732134    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v" (OuterVolumeSpecName: "kube-api-access-t7w9v") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "kube-api-access-t7w9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:28:07.732314 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.732243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:28:07.732387 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.732335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:28:07.732445 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.732404    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54fa4747-cc45-4f21-a662-e23ebb6cba4c" (UID: "54fa4747-cc45-4f21-a662-e23ebb6cba4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:07.831262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.831214    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.831262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.831249    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7w9v\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-kube-api-access-t7w9v\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.831262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.831259    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.831262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.831267    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:07.831262 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:07.831276    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54fa4747-cc45-4f21-a662-e23ebb6cba4c-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:08.270845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.270814    2564 generic.go:356] "Generic (PLEG): container finished" podID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerID="6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f" exitCode=0
Sep 11 16:28:08.271131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.270860    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"
Sep 11 16:28:08.271131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.270886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerDied","Data":"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"}
Sep 11 16:28:08.271131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.270929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2" event={"ID":"54fa4747-cc45-4f21-a662-e23ebb6cba4c","Type":"ContainerDied","Data":"ad8bd487c8cb6ee64da28857e06cf7cb1a4f9e21bda3289bdb71b798ab584f38"}
Sep 11 16:28:08.271131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.270950    2564 scope.go:117] "RemoveContainer" containerID="6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"
Sep 11 16:28:08.281746 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.281725    2564 scope.go:117] "RemoveContainer" containerID="dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"
Sep 11 16:28:08.290743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.290722    2564 scope.go:117] "RemoveContainer" containerID="6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"
Sep 11 16:28:08.291200 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:28:08.291168    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f\": container with ID starting with 6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f not found: ID does not exist" containerID="6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"
Sep 11 16:28:08.291346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.291211    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f"} err="failed to get container status \"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f\": rpc error: code = NotFound desc = could not find container \"6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f\": container with ID starting with 6c32a6bc4117239c48cc042d275f77a4ed810f667e0debf0c4207ed2ee477c2f not found: ID does not exist"
Sep 11 16:28:08.291346 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.291271    2564 scope.go:117] "RemoveContainer" containerID="dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"
Sep 11 16:28:08.291676 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:28:08.291652    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480\": container with ID starting with dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480 not found: ID does not exist" containerID="dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"
Sep 11 16:28:08.291787 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.291679    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480"} err="failed to get container status \"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480\": rpc error: code = NotFound desc = could not find container \"dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480\": container with ID starting with dafc92c3ca38a95d6b95d89e09cdfd81355ac75a612cfe00306458ea89e19480 not found: ID does not exist"
Sep 11 16:28:08.299552 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.297906    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:28:08.304128 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:08.304099    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-3db535-openshift-default-768cb77694-f8bn2"]
Sep 11 16:28:10.288967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:10.288932    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" path="/var/lib/kubelet/pods/54fa4747-cc45-4f21-a662-e23ebb6cba4c/volumes"
Sep 11 16:28:11.710446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:11.710408    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:11.710446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:11.710463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:11.723097 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:11.723069    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:12.307397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:12.307366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:28:13.472107 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.472063    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:28:13.472626 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.472315    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" podUID="84597efd-4c57-46a0-9daa-73721b52976d" containerName="maas-api" containerID="cri-o://101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f" gracePeriod=30
Sep 11 16:28:13.521024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.520991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:13.636899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.636869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:13.735512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.735425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:13.737926 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.737900    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:28:13.837593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.837555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:13.890975 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.890939    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca\") pod \"84597efd-4c57-46a0-9daa-73721b52976d\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") "
Sep 11 16:28:13.891173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.891087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") pod \"84597efd-4c57-46a0-9daa-73721b52976d\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") "
Sep 11 16:28:13.891173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.891126    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs\") pod \"84597efd-4c57-46a0-9daa-73721b52976d\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") "
Sep 11 16:28:13.891173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.891169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trfcc\" (UniqueName: \"kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc\") pod \"84597efd-4c57-46a0-9daa-73721b52976d\" (UID: \"84597efd-4c57-46a0-9daa-73721b52976d\") "
Sep 11 16:28:13.891357 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.891329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84597efd-4c57-46a0-9daa-73721b52976d" (UID: "84597efd-4c57-46a0-9daa-73721b52976d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:28:13.891561 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.891541    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84597efd-4c57-46a0-9daa-73721b52976d-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:13.893619 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.893568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84597efd-4c57-46a0-9daa-73721b52976d" (UID: "84597efd-4c57-46a0-9daa-73721b52976d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:28:13.893804 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.893781    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "84597efd-4c57-46a0-9daa-73721b52976d" (UID: "84597efd-4c57-46a0-9daa-73721b52976d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:28:13.893924 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.893833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc" (OuterVolumeSpecName: "kube-api-access-trfcc") pod "84597efd-4c57-46a0-9daa-73721b52976d" (UID: "84597efd-4c57-46a0-9daa-73721b52976d"). InnerVolumeSpecName "kube-api-access-trfcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:28:13.992511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.992414    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:13.992511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.992446    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84597efd-4c57-46a0-9daa-73721b52976d-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:13.992511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:13.992455    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trfcc\" (UniqueName: \"kubernetes.io/projected/84597efd-4c57-46a0-9daa-73721b52976d-kube-api-access-trfcc\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:28:14.191859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.191816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:14.208984 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.208952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:14.310110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.310075    2564 generic.go:356] "Generic (PLEG): container finished" podID="84597efd-4c57-46a0-9daa-73721b52976d" containerID="101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f" exitCode=0
Sep 11 16:28:14.310326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.310126    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"
Sep 11 16:28:14.310326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.310173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" event={"ID":"84597efd-4c57-46a0-9daa-73721b52976d","Type":"ContainerDied","Data":"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"}
Sep 11 16:28:14.310326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.310227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67" event={"ID":"84597efd-4c57-46a0-9daa-73721b52976d","Type":"ContainerDied","Data":"c1fefad7eeea924f0ee1ac9a0ebe634072e57250039ba436eda5b91e4ad534b9"}
Sep 11 16:28:14.310326 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.310255    2564 scope.go:117] "RemoveContainer" containerID="101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"
Sep 11 16:28:14.320454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.320433    2564 scope.go:117] "RemoveContainer" containerID="101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"
Sep 11 16:28:14.320821 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:28:14.320793    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f\": container with ID starting with 101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f not found: ID does not exist" containerID="101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"
Sep 11 16:28:14.320901 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.320832    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f"} err="failed to get container status \"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f\": rpc error: code = NotFound desc = could not find container \"101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f\": container with ID starting with 101e40725591a3bbd95953118496ac796cb78a9dbee6b5aa126447ac7b36123f not found: ID does not exist"
Sep 11 16:28:14.333890 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.333858    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:28:14.337641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.337615    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7ce5d6-7b5449985d-zsh67"]
Sep 11 16:28:14.368017 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:14.367982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:15.162745 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:15.162691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:16.054152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:16.054114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:16.286464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:16.286430    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84597efd-4c57-46a0-9daa-73721b52976d" path="/var/lib/kubelet/pods/84597efd-4c57-46a0-9daa-73721b52976d/volumes"
Sep 11 16:28:17.336511 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:17.336473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:22.117539 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:22.117493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:22.503599 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:22.503480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:22.675867 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:22.675832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:25.389751 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:25.389716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:27.919010 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:27.918972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:37.169815 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:37.169776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:44.286744 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:44.286705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:50.022666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:50.022629    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:28:50.042348 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:50.042299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:50.991159 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:50.991123    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:28:51.023233 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:51.023197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:51.434041 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:51.434007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:51.988464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:51.988431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:52.082206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:52.082165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:54.508116 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:54.508069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:55.181623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:55.181589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:55.296029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:55.295998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:55.814182 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:55.814147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:56.744457 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:56.744413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:57.494052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:57.494016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:57.592464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:57.592424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:57.758919 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:57.758884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:57.868322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:57.868281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:28:58.123461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:58.123377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:28:58.219296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:28:58.219253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:05.042816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.042725    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" podUID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" containerName="main" containerID="cri-o://e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766" gracePeriod=45
Sep 11 16:29:05.296502 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.296432    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:29:05.484608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484566    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484731    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbhpj\" (UniqueName: \"kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache\") pod \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\" (UID: \"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e\") "
Sep 11 16:29:05.484952 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.484889    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:05.485138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.485110    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.485138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.485109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home" (OuterVolumeSpecName: "home") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:05.485290 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.485188    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache" (OuterVolumeSpecName: "model-cache") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:05.487086 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.487065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm" (OuterVolumeSpecName: "dshm") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:05.487193 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.487111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:29:05.487193 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.487125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj" (OuterVolumeSpecName: "kube-api-access-dbhpj") pod "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" (UID: "7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e"). InnerVolumeSpecName "kube-api-access-dbhpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:29:05.585878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.585781    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.585878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.585817    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbhpj\" (UniqueName: \"kubernetes.io/projected/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-kube-api-access-dbhpj\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.585878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.585827    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.585878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.585835    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.585878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.585845    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:05.609166 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.609135    2564 generic.go:356] "Generic (PLEG): container finished" podID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" containerID="e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766" exitCode=0
Sep 11 16:29:05.609347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.609176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" event={"ID":"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e","Type":"ContainerDied","Data":"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"}
Sep 11 16:29:05.609347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.609182    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"
Sep 11 16:29:05.609347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.609202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49" event={"ID":"7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e","Type":"ContainerDied","Data":"27e9d530f561e28f2ba6e7651d97db384aef85569e90303b5ab17b9be28d0c26"}
Sep 11 16:29:05.609347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.609224    2564 scope.go:117] "RemoveContainer" containerID="e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"
Sep 11 16:29:05.619678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.619624    2564 scope.go:117] "RemoveContainer" containerID="e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"
Sep 11 16:29:05.620003 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:29:05.619981    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766\": container with ID starting with e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766 not found: ID does not exist" containerID="e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"
Sep 11 16:29:05.620080 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.620013    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766"} err="failed to get container status \"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766\": rpc error: code = NotFound desc = could not find container \"e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766\": container with ID starting with e16c55055663c3fd983284115602940f26ec26309061f77c4c17fa1d99820766 not found: ID does not exist"
Sep 11 16:29:05.632494 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.632459    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:29:05.636374 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:05.636343    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-1ec6e6/rate-test-model-1ec6e6-kserve-59b564dfc9-pqt49"]
Sep 11 16:29:06.010771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.010725    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" podUID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" containerName="main" containerID="cri-o://bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae" gracePeriod=45
Sep 11 16:29:06.270173 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.270103    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:29:06.287237 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.287200    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" path="/var/lib/kubelet/pods/7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e/volumes"
Sep 11 16:29:06.393614 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393579    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.393785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvzc6\" (UniqueName: \"kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.393785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393657    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.393785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.393785 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.394020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393791    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache\") pod \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\" (UID: \"70d70ef3-faee-4a21-8da1-7d0a5a16afe1\") "
Sep 11 16:29:06.394020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393897    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home" (OuterVolumeSpecName: "home") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:06.394020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.393976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:06.394185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.394150    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache" (OuterVolumeSpecName: "model-cache") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:06.394358 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.394335    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.394695 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.394450    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.396115 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.396087    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6" (OuterVolumeSpecName: "kube-api-access-vvzc6") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "kube-api-access-vvzc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:29:06.396115 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.396086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm" (OuterVolumeSpecName: "dshm") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:29:06.396260 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.396141    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70d70ef3-faee-4a21-8da1-7d0a5a16afe1" (UID: "70d70ef3-faee-4a21-8da1-7d0a5a16afe1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:29:06.495488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.495449    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.495488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.495481    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvzc6\" (UniqueName: \"kubernetes.io/projected/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-kube-api-access-vvzc6\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.495488 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.495495    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.495776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.495507    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d70ef3-faee-4a21-8da1-7d0a5a16afe1-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:29:06.616874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.616778    2564 generic.go:356] "Generic (PLEG): container finished" podID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" containerID="bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae" exitCode=0
Sep 11 16:29:06.616874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.616824    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"
Sep 11 16:29:06.616874 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.616863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" event={"ID":"70d70ef3-faee-4a21-8da1-7d0a5a16afe1","Type":"ContainerDied","Data":"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"}
Sep 11 16:29:06.617138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.616911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd" event={"ID":"70d70ef3-faee-4a21-8da1-7d0a5a16afe1","Type":"ContainerDied","Data":"e4d1171ae1bc5a7414ae925893487a88d677a12db252b6cb61049a201239a254"}
Sep 11 16:29:06.617138 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.616934    2564 scope.go:117] "RemoveContainer" containerID="bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"
Sep 11 16:29:06.627796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.627776    2564 scope.go:117] "RemoveContainer" containerID="bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"
Sep 11 16:29:06.628090 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:29:06.628073    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae\": container with ID starting with bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae not found: ID does not exist" containerID="bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"
Sep 11 16:29:06.628152 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.628100    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae"} err="failed to get container status \"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae\": rpc error: code = NotFound desc = could not find container \"bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae\": container with ID starting with bb2e73fc3b2e8fa006f471c5b81a7a8854c6ae8f7dfcf0f23d8ae571e658f3ae not found: ID does not exist"
Sep 11 16:29:06.641433 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.641403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:29:06.647067 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:06.647034    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-233d22/rate-test-model-233d22-kserve-5589664899-8fjmd"]
Sep 11 16:29:08.287176 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:08.287138    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" path="/var/lib/kubelet/pods/70d70ef3-faee-4a21-8da1-7d0a5a16afe1/volumes"
Sep 11 16:29:08.287565 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:08.287419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:29:20.187376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:20.187335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:20.750227 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:20.750199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:20.925347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:20.925299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:21.439196 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.439160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:21.445322 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445295    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:29:21.445737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445723    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445738    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445747    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" containerName="main"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445753    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" containerName="main"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445762    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84597efd-4c57-46a0-9daa-73721b52976d" containerName="maas-api"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445767    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="84597efd-4c57-46a0-9daa-73721b52976d" containerName="maas-api"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445780    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" containerName="main"
Sep 11 16:29:21.445792 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445786    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" containerName="main"
Sep 11 16:29:21.446089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445843    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d70ef3-faee-4a21-8da1-7d0a5a16afe1" containerName="main"
Sep 11 16:29:21.446089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445851    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:21.446089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445860    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="84597efd-4c57-46a0-9daa-73721b52976d" containerName="maas-api"
Sep 11 16:29:21.446089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.445865    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6d35e2-0027-41fc-b3ac-dc5cb845ee8e" containerName="main"
Sep 11 16:29:21.450321 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.450303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.453622 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.453596    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2eae3e-openshift-default-dockercfg-7zwvz\""
Sep 11 16:29:21.483475 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.483447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:29:21.532710 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.532915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.532915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.532915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.532915 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.533109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqlkz\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.533109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.532963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.533109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.533015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.533109 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.533031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqlkz\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634721 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.634886 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.635033 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.634918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.635083 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.635060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.635083 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.635073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.636869 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.636851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.637243 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.637224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.671139 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.671106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqlkz\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.678424 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.678399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token\") pod \"e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") " pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.760554 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.760504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:21.862054 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:21.862016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:22.076967 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.076941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:29:22.079504 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:29:22.079475    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8598e67b_b01b_4731_aec9_3ec6e030c720.slice/crio-2128bb7dc3478f8d8e473cf5bf9a6edab9bf3c8a25a768f1a7882845246844d5 WatchSource:0}: Error finding container 2128bb7dc3478f8d8e473cf5bf9a6edab9bf3c8a25a768f1a7882845246844d5: Status 404 returned error can't find the container with id 2128bb7dc3478f8d8e473cf5bf9a6edab9bf3c8a25a768f1a7882845246844d5
Sep 11 16:29:22.081778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.081743    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:22.081863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.081816    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:22.081863 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.081845    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:22.713812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.713778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerStarted","Data":"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"}
Sep 11 16:29:22.714305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.713826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerStarted","Data":"2128bb7dc3478f8d8e473cf5bf9a6edab9bf3c8a25a768f1a7882845246844d5"}
Sep 11 16:29:22.761221 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.761185    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:22.794492 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:22.794430    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podStartSLOduration=1.794411145 podStartE2EDuration="1.794411145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:29:22.783270786 +0000 UTC m=+1633.045516929" watchObservedRunningTime="2026-09-11 16:29:22.794411145 +0000 UTC m=+1633.056657287"
Sep 11 16:29:23.124537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:23.124470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:23.766728 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:23.766699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:24.725868 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:24.725830    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:24.726816 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:24.726792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:25.293395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:25.293359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:25.669170 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:25.669072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:25.942309 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:25.942213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:27.149629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:27.149587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:28.861272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.861235    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:29:28.861821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.861803    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:28.861821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.861822    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:28.861916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.861899    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54fa4747-cc45-4f21-a662-e23ebb6cba4c" containerName="istio-proxy"
Sep 11 16:29:28.865100 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.865085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:28.873639 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.873619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2eae3e-serving-cert\""
Sep 11 16:29:28.893419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.893381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:29:28.985847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:28.985816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:29.015393 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.015351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.015591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.015398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6d9h\" (UniqueName: \"kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.015591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.015474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.015690 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.015610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.116454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.116366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.116454 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.116453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.116674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.116489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.116674 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.116510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6d9h\" (UniqueName: \"kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.117072 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.117047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.119003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.118983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.119131 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.119033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.129213 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.129184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6d9h\" (UniqueName: \"kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h\") pod \"maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.175848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.175813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:29.213762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.213726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:29.501020 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.500997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:29:29.502580 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:29:29.502548    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8edfbc_4078_4625_b0b1_d6241cabbdc9.slice/crio-e746b09676150f617d1a6134b04db2207e2882b375583742330dea406912fae2 WatchSource:0}: Error finding container e746b09676150f617d1a6134b04db2207e2882b375583742330dea406912fae2: Status 404 returned error can't find the container with id e746b09676150f617d1a6134b04db2207e2882b375583742330dea406912fae2
Sep 11 16:29:29.754894 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.754811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" event={"ID":"7f8edfbc-4078-4625-b0b1-d6241cabbdc9","Type":"ContainerStarted","Data":"e746b09676150f617d1a6134b04db2207e2882b375583742330dea406912fae2"}
Sep 11 16:29:29.969456 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:29.969419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:30.207363 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:30.207330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:30.762594 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:30.762559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" event={"ID":"7f8edfbc-4078-4625-b0b1-d6241cabbdc9","Type":"ContainerStarted","Data":"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"}
Sep 11 16:29:30.762794 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:30.762782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:30.798427 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:30.798368    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" podStartSLOduration=2.454511863 podStartE2EDuration="2.798352144s" totalImagesPullingTime="343.840281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:29:30.796823201 +0000 UTC m=+1641.059069343" watchObservedRunningTime="2026-09-11 16:29:30.798352144 +0000 UTC m=+1641.060598286"
Sep 11 16:29:30.862743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:30.862709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:32.161105 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:32.161071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:33.365720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:33.365681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:29:33.741220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:33.741128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:36.775097 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:36.775071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:29:39.283702 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:39.283664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:43.855828 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.855793    2564 generic.go:356] "Generic (PLEG): container finished" podID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerID="dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35" exitCode=0
Sep 11 16:29:43.856265 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.855868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerDied","Data":"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"}
Sep 11 16:29:43.856311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.856299    2564 scope.go:117] "RemoveContainer" containerID="dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"
Sep 11 16:29:43.857406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.857379    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:43.857464 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.857451    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:43.857512 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:43.857499    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 16:29:44.863717 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:44.863687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerStarted","Data":"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"}
Sep 11 16:29:45.761636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:45.761591    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:45.761847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:45.761823    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:45.761899 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:45.761876    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:46.568383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:46.568346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:46.753282 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:46.753250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:46.761372 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:46.761340    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:46.761539 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:46.761394    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:47.761333 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:47.761300    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:47.761739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:47.761356    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:48.761079 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:48.761045    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:48.761264 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:48.761137    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:49.760912 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:49.760872    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:49.761296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:49.760933    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:50.761225 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:50.761190    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 16:29:50.761697 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:50.761260    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 16:29:51.765311 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:51.765283    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:51.765819 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:51.765642    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:51.766365 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:51.766341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:29:52.247113 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:52.247024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:53.360744 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:53.360710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:54.444429 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:54.444391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:55.535686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:55.535648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:55.654160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:55.654122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:29:56.838767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:29:56.838738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:02.486424 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.486386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:30:02.491369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.491344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.494673 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.494647    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9bac29\"/\"kube-root-ca.crt\""
Sep 11 16:30:02.495686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.495656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9bac29\"/\"ipp-route-9bac29-kserve-self-signed-certs\""
Sep 11 16:30:02.495821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.495697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9bac29\"/\"default-dockercfg-gzbmf\""
Sep 11 16:30:02.495821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.495696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9bac29\"/\"openshift-service-ca.crt\""
Sep 11 16:30:02.501738 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.501713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:30:02.527239 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.527204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:02.579133 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.579344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jkpk\" (UniqueName: \"kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.579344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.579344 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.579563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.579563 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.579401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680185 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jkpk\" (UniqueName: \"kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680687 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680737 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.680796 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.680775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.682817 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.682793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.683071 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.683053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.691064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.691034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jkpk\" (UniqueName: \"kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk\") pod \"ipp-route-9bac29-kserve-85588d458c-84pw8\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") " pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:02.802939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:02.802890    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:03.078160 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:03.078129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:30:03.079831 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:30:03.079798    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f78e0dc_4767_47a8_8f84_a417f78f7bef.slice/crio-d24838d417b3f714862415f2abd5fe9c72d10bf5237091e293796447c253567f WatchSource:0}: Error finding container d24838d417b3f714862415f2abd5fe9c72d10bf5237091e293796447c253567f: Status 404 returned error can't find the container with id d24838d417b3f714862415f2abd5fe9c72d10bf5237091e293796447c253567f
Sep 11 16:30:03.985881 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:03.985842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" event={"ID":"6f78e0dc-4767-47a8-8f84-a417f78f7bef","Type":"ContainerStarted","Data":"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"}
Sep 11 16:30:03.986272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:03.985893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" event={"ID":"6f78e0dc-4767-47a8-8f84-a417f78f7bef","Type":"ContainerStarted","Data":"d24838d417b3f714862415f2abd5fe9c72d10bf5237091e293796447c253567f"}
Sep 11 16:30:04.017835 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:04.017775    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" podStartSLOduration=2.01775618 podStartE2EDuration="2.01775618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:04.016449637 +0000 UTC m=+1674.278695780" watchObservedRunningTime="2026-09-11 16:30:04.01775618 +0000 UTC m=+1674.280002342"
Sep 11 16:30:07.327154 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:07.327110    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:30:12.803534 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:12.803488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:12.803939 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:12.803567    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:12.816300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:12.816269    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:13.056537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:13.056421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:30:40.377804 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:40.377702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:30:47.089029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:47.088991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:47.430852 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:47.430748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:47.565482 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:47.565443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:58.159810 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:30:58.159759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:00.244793 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:00.244753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:08.155238 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:08.155204    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:08.250298 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:08.250252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:08.357206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:08.357155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:10.024956 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:10.024924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:11.428598 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:11.428566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:12.218503 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:12.218462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:13.054059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.054015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:13.917790 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.917756    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:13.921312 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.921289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:13.923762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.923733    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-4b91c4-serving-cert\""
Sep 11 16:31:13.934126 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.934101    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:13.954031 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.953998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:13.980958 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.980928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljlg\" (UniqueName: \"kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:13.981148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.980971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:13.981148 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.981119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:13.981249 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:13.981228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.056053 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.056014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:14.081890 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.081856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.082069 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.081908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljlg\" (UniqueName: \"kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.082118 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.082076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.082223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.082208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.082743 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.082723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.084618 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.084598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.084741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.084658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.092418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.092381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljlg\" (UniqueName: \"kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg\") pod \"maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.154756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.154709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:14.234274 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.234178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:14.473679 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.473644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:14.516110 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.516086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:14.519070 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:31:14.519040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f0c18f_85e0_409b_8537_1b014bccd5fd.slice/crio-0b2ba5260e74b829a33bfbbf19512c0cfccd94a4c217c6a71ee60e6ce8362aad WatchSource:0}: Error finding container 0b2ba5260e74b829a33bfbbf19512c0cfccd94a4c217c6a71ee60e6ce8362aad: Status 404 returned error can't find the container with id 0b2ba5260e74b829a33bfbbf19512c0cfccd94a4c217c6a71ee60e6ce8362aad
Sep 11 16:31:14.564568 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:14.564511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:15.414625 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:15.414592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" event={"ID":"99f0c18f-85e0-409b-8537-1b014bccd5fd","Type":"ContainerStarted","Data":"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"}
Sep 11 16:31:15.415024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:15.414646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" event={"ID":"99f0c18f-85e0-409b-8537-1b014bccd5fd","Type":"ContainerStarted","Data":"0b2ba5260e74b829a33bfbbf19512c0cfccd94a4c217c6a71ee60e6ce8362aad"}
Sep 11 16:31:15.415024 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:15.414670    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:15.434778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:15.434717    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" podStartSLOduration=1.973433259 podStartE2EDuration="2.434678526s" totalImagesPullingTime="461.245267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:15.433601817 +0000 UTC m=+1745.695847960" watchObservedRunningTime="2026-09-11 16:31:15.434678526 +0000 UTC m=+1745.696924668"
Sep 11 16:31:18.857634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:18.857590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:31:21.426437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:21.426409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:34.745547 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:34.745477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:35.676007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:35.675975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:37.348417 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:37.348383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:38.238976 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:38.238936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:39.062061 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:39.062016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:39.815678 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:39.815629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:40.558623 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:40.558589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:41.416769 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:41.416735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:41.776425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:41.776391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:43.788229 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:43.788197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:44.873028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:44.872990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:46.000620 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:46.000588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:47.568811 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:47.568775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:48.576111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:48.576056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:49.733332 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:49.733291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.097889 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.097855    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:53.098328 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.098070    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" podUID="99f0c18f-85e0-409b-8537-1b014bccd5fd" containerName="maas-api" containerID="cri-o://f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582" gracePeriod=30
Sep 11 16:31:53.138276 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.138246    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.216772 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.216744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.331204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.331169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.361134 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.361054    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:53.426082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.426048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.486420 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.486392    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls\") pod \"99f0c18f-85e0-409b-8537-1b014bccd5fd\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") "
Sep 11 16:31:53.486634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.486460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca\") pod \"99f0c18f-85e0-409b-8537-1b014bccd5fd\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") "
Sep 11 16:31:53.486634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.486495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs\") pod \"99f0c18f-85e0-409b-8537-1b014bccd5fd\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") "
Sep 11 16:31:53.486634 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.486551    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fljlg\" (UniqueName: \"kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg\") pod \"99f0c18f-85e0-409b-8537-1b014bccd5fd\" (UID: \"99f0c18f-85e0-409b-8537-1b014bccd5fd\") "
Sep 11 16:31:53.487127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.487094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99f0c18f-85e0-409b-8537-1b014bccd5fd" (UID: "99f0c18f-85e0-409b-8537-1b014bccd5fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:31:53.488933 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.488899    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99f0c18f-85e0-409b-8537-1b014bccd5fd" (UID: "99f0c18f-85e0-409b-8537-1b014bccd5fd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:31:53.489032 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.488953    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99f0c18f-85e0-409b-8537-1b014bccd5fd" (UID: "99f0c18f-85e0-409b-8537-1b014bccd5fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:31:53.489285 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.489271    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg" (OuterVolumeSpecName: "kube-api-access-fljlg") pod "99f0c18f-85e0-409b-8537-1b014bccd5fd" (UID: "99f0c18f-85e0-409b-8537-1b014bccd5fd"). InnerVolumeSpecName "kube-api-access-fljlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:31:53.588168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.588118    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99f0c18f-85e0-409b-8537-1b014bccd5fd-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:31:53.588168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.588162    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:31:53.588168 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.588173    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fljlg\" (UniqueName: \"kubernetes.io/projected/99f0c18f-85e0-409b-8537-1b014bccd5fd-kube-api-access-fljlg\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:31:53.588416 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.588181    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99f0c18f-85e0-409b-8537-1b014bccd5fd-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:31:53.646997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.646910    2564 generic.go:356] "Generic (PLEG): container finished" podID="99f0c18f-85e0-409b-8537-1b014bccd5fd" containerID="f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582" exitCode=0
Sep 11 16:31:53.646997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.646958    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"
Sep 11 16:31:53.646997 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.646967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" event={"ID":"99f0c18f-85e0-409b-8537-1b014bccd5fd","Type":"ContainerDied","Data":"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"}
Sep 11 16:31:53.647232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.647019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k" event={"ID":"99f0c18f-85e0-409b-8537-1b014bccd5fd","Type":"ContainerDied","Data":"0b2ba5260e74b829a33bfbbf19512c0cfccd94a4c217c6a71ee60e6ce8362aad"}
Sep 11 16:31:53.647232 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.647050    2564 scope.go:117] "RemoveContainer" containerID="f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"
Sep 11 16:31:53.657360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.657341    2564 scope.go:117] "RemoveContainer" containerID="f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"
Sep 11 16:31:53.657802 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:31:53.657777    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582\": container with ID starting with f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582 not found: ID does not exist" containerID="f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"
Sep 11 16:31:53.657913 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.657811    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582"} err="failed to get container status \"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582\": rpc error: code = NotFound desc = could not find container \"f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582\": container with ID starting with f34bfbc13ab1e6d196e97326fb1636852c48f723ca04c9857c173c9f2d089582 not found: ID does not exist"
Sep 11 16:31:53.673418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.673389    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:53.685405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.685376    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4b91c4-797b5cf867-lnz6k"]
Sep 11 16:31:53.782847 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.782809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:53.959271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:53.959179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:54.286481 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:54.286449    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f0c18f-85e0-409b-8537-1b014bccd5fd" path="/var/lib/kubelet/pods/99f0c18f-85e0-409b-8537-1b014bccd5fd/volumes"
Sep 11 16:31:54.820347 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:54.820313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:55.639770 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:55.639731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:56.473235 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:56.473203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:57.470831 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:57.470798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:31:58.080875 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:31:58.080838    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:32:00.154272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:00.154233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:00.255145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:00.255105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:00.437926 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:00.437828    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:04.103993 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:04.103902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:05.249825 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:05.249790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:06.052316 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:06.052274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:06.881432 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:06.881391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:07.849767 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:07.849734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:08.601680 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:08.601649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:10.401051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:10.401027    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:32:10.405906 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:10.405886    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:32:11.285629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:11.285586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:14.244159 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:14.244111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:17.603621 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:17.603582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:32:19.920697 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:19.920663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.020033 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.020001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.124864 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.124827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.223945 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.223844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.316918 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.316886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.595922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.595887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:20.738776 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:20.738738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:21.663396 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:21.663362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:22.556759 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:22.556724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:23.373034 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:23.372991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:25.566950 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:25.566919    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:32:25.613684 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:25.613650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:32:30.771778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:30.771738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:32:40.587134 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.587073    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" podUID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" containerName="main" containerID="cri-o://14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d" gracePeriod=45
Sep 11 16:32:40.848132 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.848069    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:32:40.920201 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.920168    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" containerID="14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d" exitCode=0
Sep 11 16:32:40.920402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.920210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" event={"ID":"6f78e0dc-4767-47a8-8f84-a417f78f7bef","Type":"ContainerDied","Data":"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"}
Sep 11 16:32:40.920402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.920228    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"
Sep 11 16:32:40.920402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.920250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8" event={"ID":"6f78e0dc-4767-47a8-8f84-a417f78f7bef","Type":"ContainerDied","Data":"d24838d417b3f714862415f2abd5fe9c72d10bf5237091e293796447c253567f"}
Sep 11 16:32:40.920402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.920274    2564 scope.go:117] "RemoveContainer" containerID="14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"
Sep 11 16:32:40.929719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.929697    2564 scope.go:117] "RemoveContainer" containerID="14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"
Sep 11 16:32:40.930056 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:32:40.930035    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d\": container with ID starting with 14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d not found: ID does not exist" containerID="14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"
Sep 11 16:32:40.930124 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.930066    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d"} err="failed to get container status \"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d\": rpc error: code = NotFound desc = could not find container \"14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d\": container with ID starting with 14e71aed539e8a389f07173ea28266c3109805204ada872b3b4facb9119a8f9d not found: ID does not exist"
Sep 11 16:32:40.953202 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953167    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953223    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jkpk\" (UniqueName: \"kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953264    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953395 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953411    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir\") pod \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\" (UID: \"6f78e0dc-4767-47a8-8f84-a417f78f7bef\") "
Sep 11 16:32:40.953652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953583    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:40.953652 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home" (OuterVolumeSpecName: "home") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:40.953778 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:40.953859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953842    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-model-cache\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:40.953905 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953867    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-home\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:40.953946 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.953907    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tmp-dir\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:40.955780 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.955755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:40.955900 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.955754    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk" (OuterVolumeSpecName: "kube-api-access-7jkpk") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "kube-api-access-7jkpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:40.955954 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:40.955937    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm" (OuterVolumeSpecName: "dshm") pod "6f78e0dc-4767-47a8-8f84-a417f78f7bef" (UID: "6f78e0dc-4767-47a8-8f84-a417f78f7bef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:41.054755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:41.054717    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f78e0dc-4767-47a8-8f84-a417f78f7bef-tls-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:41.054755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:41.054749    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jkpk\" (UniqueName: \"kubernetes.io/projected/6f78e0dc-4767-47a8-8f84-a417f78f7bef-kube-api-access-7jkpk\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:41.054755 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:41.054760    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f78e0dc-4767-47a8-8f84-a417f78f7bef-dshm\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:32:41.250805 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:41.250769    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:32:41.254378 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:41.254347    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-9bac29/ipp-route-9bac29-kserve-85588d458c-84pw8"]
Sep 11 16:32:42.286846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:32:42.286817    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" path="/var/lib/kubelet/pods/6f78e0dc-4767-47a8-8f84-a417f78f7bef/volumes"
Sep 11 16:33:02.393878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:02.393837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:04.338296 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:04.338264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:09.062885 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:09.062836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:10.629890 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:10.629860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:10.756256 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:10.756218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:11.017569 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:11.017512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:11.697483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:11.697448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:13.053992 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:13.053955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:14.279057 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:14.279022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:15.150093 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:15.150057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:15.984921 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:15.984881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:22.329667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.329627    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:33:22.330145 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.329835    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" podUID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" containerName="maas-api" containerID="cri-o://ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4" gracePeriod=30
Sep 11 16:33:22.380984 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.380950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:22.495043 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.495005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:22.595693 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.595627    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:33:22.640859 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.640822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:22.772608 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.772574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:22.774649 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.774626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs\") pod \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") "
Sep 11 16:33:22.774807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.774660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca\") pod \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") "
Sep 11 16:33:22.774807 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.774714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6d9h\" (UniqueName: \"kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h\") pod \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") "
Sep 11 16:33:22.774916 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.774819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls\") pod \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\" (UID: \"7f8edfbc-4078-4625-b0b1-d6241cabbdc9\") "
Sep 11 16:33:22.775102 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.775070    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f8edfbc-4078-4625-b0b1-d6241cabbdc9" (UID: "7f8edfbc-4078-4625-b0b1-d6241cabbdc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:22.777111 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.777087    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f8edfbc-4078-4625-b0b1-d6241cabbdc9" (UID: "7f8edfbc-4078-4625-b0b1-d6241cabbdc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:22.777220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.777157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7f8edfbc-4078-4625-b0b1-d6241cabbdc9" (UID: "7f8edfbc-4078-4625-b0b1-d6241cabbdc9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:22.777220 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.777206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h" (OuterVolumeSpecName: "kube-api-access-j6d9h") pod "7f8edfbc-4078-4625-b0b1-d6241cabbdc9" (UID: "7f8edfbc-4078-4625-b0b1-d6241cabbdc9"). InnerVolumeSpecName "kube-api-access-j6d9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:22.875739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.875646    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6d9h\" (UniqueName: \"kubernetes.io/projected/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-kube-api-access-j6d9h\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:22.875739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.875681    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:22.875739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.875690    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:22.875739 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.875698    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8edfbc-4078-4625-b0b1-d6241cabbdc9-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:22.884629 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:22.884596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:23.169812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.169713    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" containerID="ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4" exitCode=0
Sep 11 16:33:23.169812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.169759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" event={"ID":"7f8edfbc-4078-4625-b0b1-d6241cabbdc9","Type":"ContainerDied","Data":"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"}
Sep 11 16:33:23.169812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.169766    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"
Sep 11 16:33:23.169812 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.169800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq" event={"ID":"7f8edfbc-4078-4625-b0b1-d6241cabbdc9","Type":"ContainerDied","Data":"e746b09676150f617d1a6134b04db2207e2882b375583742330dea406912fae2"}
Sep 11 16:33:23.170157 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.169823    2564 scope.go:117] "RemoveContainer" containerID="ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"
Sep 11 16:33:23.179848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.179833    2564 scope.go:117] "RemoveContainer" containerID="ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"
Sep 11 16:33:23.180144 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:33:23.180115    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4\": container with ID starting with ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4 not found: ID does not exist" containerID="ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"
Sep 11 16:33:23.180217 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.180156    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4"} err="failed to get container status \"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4\": rpc error: code = NotFound desc = could not find container \"ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4\": container with ID starting with ce118886156c6c270f9af3604cd1e45efd7c0bc04663264f8ee66addaa515ba4 not found: ID does not exist"
Sep 11 16:33:23.222791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.222755    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:33:23.227719 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.227686    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2eae3e-78775645fc-rq5sq"]
Sep 11 16:33:23.270775 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.270744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:23.381401 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:23.381369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:24.287808 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:24.287773    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" path="/var/lib/kubelet/pods/7f8edfbc-4078-4625-b0b1-d6241cabbdc9/volumes"
Sep 11 16:33:24.481537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:24.481488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:25.760802 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:25.760757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:26.371039 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:26.371001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:33:30.527709 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:30.527675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:30.633272 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:30.633224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:30.836242 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:30.836141    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:33:30.836425 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:30.836401    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy" containerID="cri-o://dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75" gracePeriod=30
Sep 11 16:33:30.914174 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:30.914141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:31.721841 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:31.721808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:33.329591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:33.329557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:34.434226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:34.434189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:35.212636 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:35.212594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:36.091987 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.091952    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:33:36.102686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102686 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102672    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqlkz\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102839    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.102929 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102922    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.103275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102965    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token\") pod \"8598e67b-b01b-4731-aec9-3ec6e030c720\" (UID: \"8598e67b-b01b-4731-aec9-3ec6e030c720\") "
Sep 11 16:33:36.103275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102921    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:36.103275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:36.103275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103138    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:36.103275 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.102999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data" (OuterVolumeSpecName: "istio-data") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:36.103537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103381    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.103537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:36.103537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103400    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8598e67b-b01b-4731-aec9-3ec6e030c720-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.103537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103416    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.103537 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.103430    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.105848 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.105815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:36.105943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.105815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:33:36.105994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.105956    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token" (OuterVolumeSpecName: "istio-token") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:36.105994 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.105958    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz" (OuterVolumeSpecName: "kube-api-access-tqlkz") pod "8598e67b-b01b-4731-aec9-3ec6e030c720" (UID: "8598e67b-b01b-4731-aec9-3ec6e030c720"). InnerVolumeSpecName "kube-api-access-tqlkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:36.204650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.204610    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.204650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.204641    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.204650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.204652    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqlkz\" (UniqueName: \"kubernetes.io/projected/8598e67b-b01b-4731-aec9-3ec6e030c720-kube-api-access-tqlkz\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.204650 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.204663    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8598e67b-b01b-4731-aec9-3ec6e030c720-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.204930 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.204672    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8598e67b-b01b-4731-aec9-3ec6e030c720-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:36.249221 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.249189    2564 generic.go:356] "Generic (PLEG): container finished" podID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerID="dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75" exitCode=0
Sep 11 16:33:36.249399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.249239    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"
Sep 11 16:33:36.249399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.249262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerDied","Data":"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"}
Sep 11 16:33:36.249399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.249304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4" event={"ID":"8598e67b-b01b-4731-aec9-3ec6e030c720","Type":"ContainerDied","Data":"2128bb7dc3478f8d8e473cf5bf9a6edab9bf3c8a25a768f1a7882845246844d5"}
Sep 11 16:33:36.249399 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.249325    2564 scope.go:117] "RemoveContainer" containerID="dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"
Sep 11 16:33:36.259338 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.259314    2564 scope.go:117] "RemoveContainer" containerID="dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"
Sep 11 16:33:36.268756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.268736    2564 scope.go:117] "RemoveContainer" containerID="dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"
Sep 11 16:33:36.269039 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:33:36.269020    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75\": container with ID starting with dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75 not found: ID does not exist" containerID="dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"
Sep 11 16:33:36.269090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.269049    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75"} err="failed to get container status \"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75\": rpc error: code = NotFound desc = could not find container \"dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75\": container with ID starting with dbcbac2611638308cd0bf544dd72daade1d0a31d7e5dc092a45a15bc9457dc75 not found: ID does not exist"
Sep 11 16:33:36.269090 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.269068    2564 scope.go:117] "RemoveContainer" containerID="dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"
Sep 11 16:33:36.269325 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:33:36.269304    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35\": container with ID starting with dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35 not found: ID does not exist" containerID="dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"
Sep 11 16:33:36.269372 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.269333    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35"} err="failed to get container status \"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35\": rpc error: code = NotFound desc = could not find container \"dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35\": container with ID starting with dce80df4596cf9d8b3ab90fceb5960f6af471677a6200ab695759a8229080d35 not found: ID does not exist"
Sep 11 16:33:36.288127 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.288095    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:33:36.293383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:36.293352    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2eae3e-openshift-default-6f74bfbcf8-fxtw4"]
Sep 11 16:33:38.286811 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:38.286777    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" path="/var/lib/kubelet/pods/8598e67b-b01b-4731-aec9-3ec6e030c720/volumes"
Sep 11 16:33:41.967350 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:41.967319    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:33:41.967762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:41.967564    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" podUID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" containerName="maas-api" containerID="cri-o://f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a" gracePeriod=30
Sep 11 16:33:42.027716 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.027679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.141206 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.141121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.225036 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.224970    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:33:42.231943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.231919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.263082 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.263048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") pod \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") "
Sep 11 16:33:42.263270 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.263146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ljc6\" (UniqueName: \"kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6\") pod \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") "
Sep 11 16:33:42.263270 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.263207    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca\") pod \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") "
Sep 11 16:33:42.263270 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.263233    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs\") pod \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\" (UID: \"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b\") "
Sep 11 16:33:42.263641 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.263608    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" (UID: "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:42.265720 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.265695    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" (UID: "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:42.266037 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.266013    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" (UID: "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:42.266091 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.266021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6" (OuterVolumeSpecName: "kube-api-access-8ljc6") pod "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" (UID: "f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b"). InnerVolumeSpecName "kube-api-access-8ljc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:42.285694 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.285656    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" containerID="f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a" exitCode=0
Sep 11 16:33:42.285846 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.285757    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"
Sep 11 16:33:42.287360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.287316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" event={"ID":"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b","Type":"ContainerDied","Data":"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"}
Sep 11 16:33:42.287360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.287358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v" event={"ID":"f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b","Type":"ContainerDied","Data":"d1a7c7982f35237de058b3fc124b9b43305494418bc0f04211527d42140f3eb1"}
Sep 11 16:33:42.287616 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.287381    2564 scope.go:117] "RemoveContainer" containerID="f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"
Sep 11 16:33:42.297961 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.297941    2564 scope.go:117] "RemoveContainer" containerID="f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"
Sep 11 16:33:42.298293 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:33:42.298274    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a\": container with ID starting with f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a not found: ID does not exist" containerID="f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"
Sep 11 16:33:42.298354 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.298306    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a"} err="failed to get container status \"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a\": rpc error: code = NotFound desc = could not find container \"f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a\": container with ID starting with f3f05c1085aecf27f94129a5d5628274b609cfe40d995dbeb1fc996598184f8a not found: ID does not exist"
Sep 11 16:33:42.314098 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.314069    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:33:42.323021 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.322987    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ec6e6-774664fb4-wtg4v"]
Sep 11 16:33:42.327271 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.327242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.364257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.364226    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:42.364257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.364253    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ljc6\" (UniqueName: \"kubernetes.io/projected/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-kube-api-access-8ljc6\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:42.364257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.364263    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:42.364257 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.364276    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:33:42.410932 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.410900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.691252 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.691218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:42.792625 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:42.792590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:43.539538 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:43.539474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:44.286842 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:44.286797    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" path="/var/lib/kubelet/pods/f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b/volumes"
Sep 11 16:33:44.990351 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:44.990308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:33:49.015405 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:49.015371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:49.117116 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:49.117019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:49.297762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:49.297722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:49.984255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:49.984216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:51.167419 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:51.167382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:33:52.473736 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:33:52.473694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:00.412756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.412721    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:34:00.413251 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.412984    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" podUID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" containerName="maas-api" containerID="cri-o://a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae" gracePeriod=30
Sep 11 16:34:00.448408 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.448380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:00.558077 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.558042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:00.658376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.658346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:00.669656 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.669593    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:34:00.766610 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.766574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:00.844207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.844173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") pod \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") "
Sep 11 16:34:00.844207 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.844213    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q74j\" (UniqueName: \"kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j\") pod \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") "
Sep 11 16:34:00.844437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.844253    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca\") pod \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") "
Sep 11 16:34:00.844437 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.844288    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs\") pod \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\" (UID: \"0d0282bb-03fb-4ca9-8525-00c88f4a240e\") "
Sep 11 16:34:00.844732 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.844686    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d0282bb-03fb-4ca9-8525-00c88f4a240e" (UID: "0d0282bb-03fb-4ca9-8525-00c88f4a240e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:34:00.846571 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.846538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d0282bb-03fb-4ca9-8525-00c88f4a240e" (UID: "0d0282bb-03fb-4ca9-8525-00c88f4a240e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:34:00.846726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.846619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j" (OuterVolumeSpecName: "kube-api-access-9q74j") pod "0d0282bb-03fb-4ca9-8525-00c88f4a240e" (UID: "0d0282bb-03fb-4ca9-8525-00c88f4a240e"). InnerVolumeSpecName "kube-api-access-9q74j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:00.846726 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.846627    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d0282bb-03fb-4ca9-8525-00c88f4a240e" (UID: "0d0282bb-03fb-4ca9-8525-00c88f4a240e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:34:00.945866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.945767    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-maas-api-tls\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:00.945866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.945803    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q74j\" (UniqueName: \"kubernetes.io/projected/0d0282bb-03fb-4ca9-8525-00c88f4a240e-kube-api-access-9q74j\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:00.945866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.945813    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0282bb-03fb-4ca9-8525-00c88f4a240e-openshift-service-ca\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:00.945866 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:00.945822    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d0282bb-03fb-4ca9-8525-00c88f4a240e-metrics-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:01.196850 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.196762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:01.348771 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.348739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:01.396853 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.396818    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" containerID="a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae" exitCode=0
Sep 11 16:34:01.397028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.396869    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"
Sep 11 16:34:01.397028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.396911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" event={"ID":"0d0282bb-03fb-4ca9-8525-00c88f4a240e","Type":"ContainerDied","Data":"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"}
Sep 11 16:34:01.397028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.396969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d" event={"ID":"0d0282bb-03fb-4ca9-8525-00c88f4a240e","Type":"ContainerDied","Data":"9ecc06b822118ec4bbf25b175760646fb9525439238fa9c8d5bc5e2586ba74ca"}
Sep 11 16:34:01.397028 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.396995    2564 scope.go:117] "RemoveContainer" containerID="a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"
Sep 11 16:34:01.407542 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.407507    2564 scope.go:117] "RemoveContainer" containerID="a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"
Sep 11 16:34:01.407858 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:34:01.407833    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae\": container with ID starting with a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae not found: ID does not exist" containerID="a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"
Sep 11 16:34:01.407936 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.407868    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae"} err="failed to get container status \"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae\": rpc error: code = NotFound desc = could not find container \"a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae\": container with ID starting with a090ccdca1bcdf48c8ecd408ac95c4c4d54213b9486aae997c861a986e64cdae not found: ID does not exist"
Sep 11 16:34:01.433158 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.433127    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:34:01.437953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:01.437915    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-233d22-694967f555-hk76d"]
Sep 11 16:34:02.287175 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:02.287139    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" path="/var/lib/kubelet/pods/0d0282bb-03fb-4ca9-8525-00c88f4a240e/volumes"
Sep 11 16:34:03.478223 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:03.478189    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:34:07.865179 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:07.865140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:07.965934 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:07.965905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:08.108452 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:08.108422    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:34:08.108668 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:08.108645    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy" containerID="cri-o://d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982" gracePeriod=30
Sep 11 16:34:08.148712 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:08.148601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:13.079446 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.079401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:34:13.377632 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.377603    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:34:13.455029 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.454993    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455140    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxrtd\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455197 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455209    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455461 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data\") pod \"1cc87014-1520-4da8-8e56-959bdfd0ea71\" (UID: \"1cc87014-1520-4da8-8e56-959bdfd0ea71\") "
Sep 11 16:34:13.455666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:13.455666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:13.455666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:34:13.455666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455658    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-certs\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.455865 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:13.456051 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.455981    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:13.457560 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.457534    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:13.457762 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.457736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:34:13.457833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.457780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd" (OuterVolumeSpecName: "kube-api-access-vxrtd") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "kube-api-access-vxrtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:13.457879 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.457836    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cc87014-1520-4da8-8e56-959bdfd0ea71" (UID: "1cc87014-1520-4da8-8e56-959bdfd0ea71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:13.467735 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.467706    2564 generic.go:356] "Generic (PLEG): container finished" podID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerID="d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982" exitCode=0
Sep 11 16:34:13.467896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.467760    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"
Sep 11 16:34:13.467896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.467793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerDied","Data":"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"}
Sep 11 16:34:13.467896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.467853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb" event={"ID":"1cc87014-1520-4da8-8e56-959bdfd0ea71","Type":"ContainerDied","Data":"6fffc1e4b068bbabef2ae836fcab42eb132d4f7466400bc72727648c681ad923"}
Sep 11 16:34:13.467896 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.467886    2564 scope.go:117] "RemoveContainer" containerID="d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"
Sep 11 16:34:13.481820 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.481796    2564 scope.go:117] "RemoveContainer" containerID="24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"
Sep 11 16:34:13.491397 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.491374    2564 scope.go:117] "RemoveContainer" containerID="d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"
Sep 11 16:34:13.491944 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:34:13.491918    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982\": container with ID starting with d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982 not found: ID does not exist" containerID="d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"
Sep 11 16:34:13.492070 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.491955    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982"} err="failed to get container status \"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982\": rpc error: code = NotFound desc = could not find container \"d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982\": container with ID starting with d057dfdf4399baa8f351a1cefc96dcc8a593aa59194cec2ce3da90a5e88e0982 not found: ID does not exist"
Sep 11 16:34:13.492070 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.491987    2564 scope.go:117] "RemoveContainer" containerID="24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"
Sep 11 16:34:13.492379 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:34:13.492345    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766\": container with ID starting with 24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766 not found: ID does not exist" containerID="24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"
Sep 11 16:34:13.492495 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.492379    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766"} err="failed to get container status \"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766\": rpc error: code = NotFound desc = could not find container \"24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766\": container with ID starting with 24d9afb47f37bd9c1057d2e69a336f130ce5e2f677e481891a2678a02da3e766 not found: ID does not exist"
Sep 11 16:34:13.494922 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.494897    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:34:13.504052 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.504018    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-233d22-openshift-default-6f94b5cd6b-xskqb"]
Sep 11 16:34:13.556763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556727    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-token\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556758    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-credential-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556763 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556767    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-podinfo\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556777    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-data\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556785    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-istio-envoy\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556792    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc87014-1520-4da8-8e56-959bdfd0ea71-workload-socket\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556799    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc87014-1520-4da8-8e56-959bdfd0ea71-istiod-ca-cert\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:13.556942 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:13.556807    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrtd\" (UniqueName: \"kubernetes.io/projected/1cc87014-1520-4da8-8e56-959bdfd0ea71-kube-api-access-vxrtd\") on node \"ip-10-0-137-9.ec2.internal\" DevicePath \"\""
Sep 11 16:34:14.291014 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:14.290977    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" path="/var/lib/kubelet/pods/1cc87014-1520-4da8-8e56-959bdfd0ea71/volumes"
Sep 11 16:34:27.631953 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:27.631916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:34:27.800406 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:34:27.800368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:14.539576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:35:14.539539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:33.722489 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:35:33.722453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:36.294791 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:35:36.294752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:37.792305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:35:37.792255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:35:43.884570 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:35:43.884504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:09.154856 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:09.154775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:23.807680 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:23.807574    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T16:36:13Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T16:36:13Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T16:36:13Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T16:36:13Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-137-9.ec2.internal\": Patch \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-9.ec2.internal/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:24.201451 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:24.201364    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3ece49f-abe0-4ce6-9a25-877c954f4bd4" containerID="9f7d51faac0725d6eca0b2fbfe9ed57a493fd9726a0ce900c4e016e8ef7a8de9" exitCode=1
Sep 11 16:36:24.201451 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:24.201438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerDied","Data":"9f7d51faac0725d6eca0b2fbfe9ed57a493fd9726a0ce900c4e016e8ef7a8de9"}
Sep 11 16:36:24.201872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:24.201857    2564 scope.go:117] "RemoveContainer" containerID="9f7d51faac0725d6eca0b2fbfe9ed57a493fd9726a0ce900c4e016e8ef7a8de9"
Sep 11 16:36:24.202156 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:24.202145    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:36:24.835377 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:24.835338    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:36:25.209669 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:25.209578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" event={"ID":"b3ece49f-abe0-4ce6-9a25-877c954f4bd4","Type":"ContainerStarted","Data":"85614042b4186155528642feab84d675f4e9486ec7dde9de119fe3a50fc368af"}
Sep 11 16:36:25.209833 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:25.209815    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:36:29.108768 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:29.108715    2564 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-9.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:33.808022 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:33.807926    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-9.ec2.internal\": Get \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:36.216423 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:36.216381    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" podUID="b3ece49f-abe0-4ce6-9a25-877c954f4bd4" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.33:8081/readyz\": dial tcp 10.132.0.33:8081: connect: connection refused"
Sep 11 16:36:39.109316 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:39.109257    2564 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:43.808914 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:43.808868    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-9.ec2.internal\": Get \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-9.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 11 16:36:46.215244 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:46.215193    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr" podUID="b3ece49f-abe0-4ce6-9a25-877c954f4bd4" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.33:8081/readyz\": dial tcp 10.132.0.33:8081: connect: connection refused"
Sep 11 16:36:49.110288 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:49.110234    2564 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-9.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:51.877981 ip-10-0-137-9 kubenswrapper[2564]: E0911 16:36:51.877942    2564 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-137-9.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Sep 11 16:36:51.983649 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:51.983607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:52.320704 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:52.320663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:53.160757 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:53.160717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:56.216532 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:56.216497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-6bzfr"
Sep 11 16:36:57.597204 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:57.597148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:36:57.728130 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:36:57.728097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:02.135486 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:02.135450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:03.903003 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:03.902970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:04.431581 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:04.431549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:04.967226 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:04.967190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:07.460545 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:07.460479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:10.440325 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:10.440297    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:37:10.446407 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:10.446384    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wmjq2_2ff4d80e-c970-4f2f-a72d-913d405ec8c4/ovn-acl-logging/0.log"
Sep 11 16:37:12.569591 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:12.569558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:14.581297 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:14.581254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:15.254485 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:15.254439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-q2dbj"]
Sep 11 16:37:18.181784 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:18.181738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:18.590421 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:18.590382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:22.851666 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:22.851637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-6bzfr_b3ece49f-abe0-4ce6-9a25-877c954f4bd4/copy-manifests/0.log"
Sep 11 16:37:22.867483 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:22.867451    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-6bzfr_b3ece49f-abe0-4ce6-9a25-877c954f4bd4/manager/1.log"
Sep 11 16:37:23.646105 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:23.646066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:23.707888 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:23.707860    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819055-s856t_6fa6fd0f-bbdd-4689-af46-57b950d758d5/cleanup/0.log"
Sep 11 16:37:23.867910 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:23.867877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:24.759640 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:24.759605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:25.042455 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:25.042372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:25.214191 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:25.214166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-hrbvk_bd7a5371-d739-4292-84e3-4184255a484d/kuadrant-console-plugin/0.log"
Sep 11 16:37:25.302361 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:25.302264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:25.515240 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:25.515214    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-q2dbj_8048b2c4-20f1-4df1-8de4-6a8e31078193/limitador/0.log"
Sep 11 16:37:26.344100 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:26.344069    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5864499db4-dbf4x_9ad36943-0fe9-4ffc-b371-3c7f3ad81411/kube-auth-proxy/0.log"
Sep 11 16:37:27.422602 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:27.422567    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rvpxs_d5cd621a-bc8e-4deb-9a32-d5cfa4599224/main/0.log"
Sep 11 16:37:28.232383 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:28.232352    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lzdbq_dac8b624-9de1-4501-a46d-f9a89d0d4d53/main/0.log"
Sep 11 16:37:29.162667 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:29.162629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.012491 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.012452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.223019 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.222980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.888836 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.888797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:33.894506 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894477    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh25b/must-gather-8pv8k"]
Sep 11 16:37:33.894880 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894866    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" containerName="maas-api"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894883    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" containerName="maas-api"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894891    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" containerName="maas-api"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894897    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" containerName="maas-api"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894903    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" containerName="main"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894909    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" containerName="main"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894919    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894924    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.894928 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894930    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894935    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894953    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f0c18f-85e0-409b-8537-1b014bccd5fd" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894958    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f0c18f-85e0-409b-8537-1b014bccd5fd" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894965    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894969    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894976    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894982    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894993    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.894998    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895051    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9546ed0-0fd7-4f29-82fa-290ce1fa4e6b" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895059    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895066    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d0282bb-03fb-4ca9-8525-00c88f4a240e" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895073    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f78e0dc-4767-47a8-8f84-a417f78f7bef" containerName="main"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895078    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895084    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8edfbc-4078-4625-b0b1-d6241cabbdc9" containerName="maas-api"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895090    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc87014-1520-4da8-8e56-959bdfd0ea71" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895096    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8598e67b-b01b-4731-aec9-3ec6e030c720" containerName="istio-proxy"
Sep 11 16:37:33.895171 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.895103    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f0c18f-85e0-409b-8537-1b014bccd5fd" containerName="maas-api"
Sep 11 16:37:33.899784 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.899766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:33.904013 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.903986    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh25b\"/\"openshift-service-ca.crt\""
Sep 11 16:37:33.908914 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.908893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jh25b\"/\"default-dockercfg-t8w88\""
Sep 11 16:37:33.909026 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.909002    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh25b\"/\"kube-root-ca.crt\""
Sep 11 16:37:33.940756 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:33.940728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/must-gather-8pv8k"]
Sep 11 16:37:34.007735 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.007694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92c10677-6617-4c84-ad0f-2b96b18c6b6d-must-gather-output\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.007923 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.007748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhqf\" (UniqueName: \"kubernetes.io/projected/92c10677-6617-4c84-ad0f-2b96b18c6b6d-kube-api-access-rnhqf\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.109306 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.109271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92c10677-6617-4c84-ad0f-2b96b18c6b6d-must-gather-output\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.109837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.109331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhqf\" (UniqueName: \"kubernetes.io/projected/92c10677-6617-4c84-ad0f-2b96b18c6b6d-kube-api-access-rnhqf\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.109837 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.109631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92c10677-6617-4c84-ad0f-2b96b18c6b6d-must-gather-output\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.121606 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.121579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhqf\" (UniqueName: \"kubernetes.io/projected/92c10677-6617-4c84-ad0f-2b96b18c6b6d-kube-api-access-rnhqf\") pod \"must-gather-8pv8k\" (UID: \"92c10677-6617-4c84-ad0f-2b96b18c6b6d\") " pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.135375 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.135331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:34.209761 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.209674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/must-gather-8pv8k"
Sep 11 16:37:34.521009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.520981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/must-gather-8pv8k"]
Sep 11 16:37:34.523015 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:37:34.522981    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92c10677_6617_4c84_ad0f_2b96b18c6b6d.slice/crio-7bd2789a208f96baecb0288a78073c53e32718af49751313bdd94560a82ac7ca WatchSource:0}: Error finding container 7bd2789a208f96baecb0288a78073c53e32718af49751313bdd94560a82ac7ca: Status 404 returned error can't find the container with id 7bd2789a208f96baecb0288a78073c53e32718af49751313bdd94560a82ac7ca
Sep 11 16:37:34.605078 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.605039    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/must-gather-8pv8k" event={"ID":"92c10677-6617-4c84-ad0f-2b96b18c6b6d","Type":"ContainerStarted","Data":"7bd2789a208f96baecb0288a78073c53e32718af49751313bdd94560a82ac7ca"}
Sep 11 16:37:34.617424 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.617397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:34.886369 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:34.886274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log" limit=1024
Sep 11 16:37:36.618593 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:36.618552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/must-gather-8pv8k" event={"ID":"92c10677-6617-4c84-ad0f-2b96b18c6b6d","Type":"ContainerStarted","Data":"2275df37ae0611a048678a6f81a91b31781d75d2c006d31f5e7a81eca51e4b50"}
Sep 11 16:37:36.619061 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:36.618608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/must-gather-8pv8k" event={"ID":"92c10677-6617-4c84-ad0f-2b96b18c6b6d","Type":"ContainerStarted","Data":"626a8806e59af7300c252c8f032306c605565b1669c97eb9bd1027355a1e10d1"}
Sep 11 16:37:38.768878 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:38.768839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qnghp_e747732e-9b92-4c3e-9bbf-72b2ae4d7cbb/global-pull-secret-syncer/0.log"
Sep 11 16:37:39.378402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:39.378365    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9rd6q_411c70e3-10ef-47cf-8d15-44c55aba379f/konnectivity-agent/0.log"
Sep 11 16:37:39.919199 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:39.919126    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-9.ec2.internal_2fb030d2ec200c8398616ddd90968f8e/haproxy/0.log"
Sep 11 16:37:43.418657 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:43.418629    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-hrbvk_bd7a5371-d739-4292-84e3-4184255a484d/kuadrant-console-plugin/0.log"
Sep 11 16:37:43.543360 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:43.543320    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-q2dbj_8048b2c4-20f1-4df1-8de4-6a8e31078193/limitador/0.log"
Sep 11 16:37:45.391144 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.391107    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/alertmanager/0.log"
Sep 11 16:37:45.451418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.450922    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/config-reloader/0.log"
Sep 11 16:37:45.521299 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.521270    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/kube-rbac-proxy-web/0.log"
Sep 11 16:37:45.601707 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.601629    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/kube-rbac-proxy/0.log"
Sep 11 16:37:45.703943 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.703865    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/kube-rbac-proxy-metric/0.log"
Sep 11 16:37:45.797742 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.797693    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/prom-label-proxy/0.log"
Sep 11 16:37:45.874402 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:45.874323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e0ebd23-c194-4e3c-9d3a-842c9643b8f2/init-config-reloader/0.log"
Sep 11 16:37:46.125167 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.125125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-ckrzm_8d1ad5ff-c201-433f-be78-bd09d457e8ed/kube-state-metrics/0.log"
Sep 11 16:37:46.190663 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.190626    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-ckrzm_8d1ad5ff-c201-433f-be78-bd09d457e8ed/kube-rbac-proxy-main/0.log"
Sep 11 16:37:46.236255 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.236228    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-ckrzm_8d1ad5ff-c201-433f-be78-bd09d457e8ed/kube-rbac-proxy-self/0.log"
Sep 11 16:37:46.298376 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.298349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bd6d96b8d-tkfhx_aa8db1a9-adc0-439c-8c09-12411e5b8b63/metrics-server/0.log"
Sep 11 16:37:46.423208 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.423123    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wt5z_c5a22ba7-571e-4614-be62-1d61fbaf2509/node-exporter/0.log"
Sep 11 16:37:46.459064 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.459032    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wt5z_c5a22ba7-571e-4614-be62-1d61fbaf2509/kube-rbac-proxy/0.log"
Sep 11 16:37:46.503845 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:46.503820    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9wt5z_c5a22ba7-571e-4614-be62-1d61fbaf2509/init-textfile/0.log"
Sep 11 16:37:47.521569 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.521540    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-grjk2_f2d9f489-22b5-41de-a506-30e66aa6a063/prometheus-operator/0.log"
Sep 11 16:37:47.571472 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.571442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-grjk2_f2d9f489-22b5-41de-a506-30e66aa6a063/kube-rbac-proxy/0.log"
Sep 11 16:37:47.637492 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.637461    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-rlhzg_ffb812fa-450a-4376-8e2c-e0617566b0e6/prometheus-operator-admission-webhook/0.log"
Sep 11 16:37:47.692821 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.692782    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57459847cf-m2qp5_3c3dfd99-6e22-4696-9f42-51cc4c624be0/telemeter-client/0.log"
Sep 11 16:37:47.720150 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.720112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57459847cf-m2qp5_3c3dfd99-6e22-4696-9f42-51cc4c624be0/reload/0.log"
Sep 11 16:37:47.749500 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:47.749466    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57459847cf-m2qp5_3c3dfd99-6e22-4696-9f42-51cc4c624be0/kube-rbac-proxy/0.log"
Sep 11 16:37:48.065576 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.065494    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh25b/must-gather-8pv8k" podStartSLOduration=13.59675966 podStartE2EDuration="15.065469622s" totalImagesPullingTime="1.468709962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:36.653440622 +0000 UTC m=+2126.915686764" watchObservedRunningTime="2026-09-11 16:37:48.065469622 +0000 UTC m=+2138.327715765"
Sep 11 16:37:48.065779 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.065755    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"]
Sep 11 16:37:48.071851 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.071816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.089362 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.089331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"]
Sep 11 16:37:48.260007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.259964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-proc\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.260007 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.260012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5rb\" (UniqueName: \"kubernetes.io/projected/b34ca102-2d0f-4552-8d0c-5d0565359e5f-kube-api-access-xq5rb\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.260305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.260087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-podres\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.260305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.260163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-sys\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.260305 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.260231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-lib-modules\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-podres\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361187 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-sys\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-lib-modules\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-sys\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-lib-modules\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-proc\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-podres\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b34ca102-2d0f-4552-8d0c-5d0565359e5f-proc\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.361418 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.361389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5rb\" (UniqueName: \"kubernetes.io/projected/b34ca102-2d0f-4552-8d0c-5d0565359e5f-kube-api-access-xq5rb\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.371990 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.371953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5rb\" (UniqueName: \"kubernetes.io/projected/b34ca102-2d0f-4552-8d0c-5d0565359e5f-kube-api-access-xq5rb\") pod \"perf-node-gather-daemonset-8k82f\" (UID: \"b34ca102-2d0f-4552-8d0c-5d0565359e5f\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.390872 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.390838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:48.684626 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.684594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"]
Sep 11 16:37:48.686713 ip-10-0-137-9 kubenswrapper[2564]: W0911 16:37:48.686668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb34ca102_2d0f_4552_8d0c_5d0565359e5f.slice/crio-28484ef1e9f6a5b55bbdf2f64bb95ef3bcabb075b2d0500701e7169083b07118 WatchSource:0}: Error finding container 28484ef1e9f6a5b55bbdf2f64bb95ef3bcabb075b2d0500701e7169083b07118: Status 404 returned error can't find the container with id 28484ef1e9f6a5b55bbdf2f64bb95ef3bcabb075b2d0500701e7169083b07118
Sep 11 16:37:48.732741 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:48.732700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f" event={"ID":"b34ca102-2d0f-4552-8d0c-5d0565359e5f","Type":"ContainerStarted","Data":"28484ef1e9f6a5b55bbdf2f64bb95ef3bcabb075b2d0500701e7169083b07118"}
Sep 11 16:37:49.743084 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:49.743048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f" event={"ID":"b34ca102-2d0f-4552-8d0c-5d0565359e5f","Type":"ContainerStarted","Data":"6974648e5a00064171b3df253acb52f5e0c0ec19cc9476703c47266fdd09beab"}
Sep 11 16:37:49.743597 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:49.743170    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:49.764450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:49.764374    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f" podStartSLOduration=1.7643512559999999 podStartE2EDuration="1.764351256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:49.76141937 +0000 UTC m=+2140.023665513" watchObservedRunningTime="2026-09-11 16:37:49.764351256 +0000 UTC m=+2140.026597399"
Sep 11 16:37:50.386367 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:50.386341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd4fd98c8-2xwkg_a949f935-cf1a-4b22-bf0b-abfa877d4cd3/console/0.log"
Sep 11 16:37:52.348214 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:52.348167    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sth7n_0c956b3a-2e06-470b-98d9-1a9402055475/dns/0.log"
Sep 11 16:37:52.373089 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:52.373062    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sth7n_0c956b3a-2e06-470b-98d9-1a9402055475/kube-rbac-proxy/0.log"
Sep 11 16:37:52.561009 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:52.560978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vrmwc_b8797a6d-39fa-46b4-8b90-412bff41a9ff/dns-node-resolver/0.log"
Sep 11 16:37:53.400059 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:53.400022    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75zgf_d96f5a19-a75d-42d8-be59-dee9403bd82c/node-ca/0.log"
Sep 11 16:37:55.147450 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:55.147418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5864499db4-dbf4x_9ad36943-0fe9-4ffc-b371-3c7f3ad81411/kube-auth-proxy/0.log"
Sep 11 16:37:55.760289 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:55.760263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-8k82f"
Sep 11 16:37:57.475125 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:57.475087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mm8md_81d531fa-cf83-4040-8b45-41e3820705c1/serve-healthcheck-canary/0.log"
Sep 11 16:37:58.767259 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:58.767220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-wzntf_f9f9ac78-f480-4e91-8de6-0e3ad1b45457/insights-operator/0.log"
Sep 11 16:37:58.768750 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:58.768725    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-wzntf_f9f9ac78-f480-4e91-8de6-0e3ad1b45457/insights-operator/1.log"
Sep 11 16:37:59.415484 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:59.415449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d89wq_72026b0e-d0b7-422b-b5ef-990410eae593/kube-rbac-proxy/0.log"
Sep 11 16:37:59.541439 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:59.541396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d89wq_72026b0e-d0b7-422b-b5ef-990410eae593/exporter/0.log"
Sep 11 16:37:59.682297 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:37:59.682210    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d89wq_72026b0e-d0b7-422b-b5ef-990410eae593/extractor/0.log"
Sep 11 16:38:00.094733 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:00.094704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5864499db4-dbf4x_9ad36943-0fe9-4ffc-b371-3c7f3ad81411/kube-auth-proxy/0.log"
Sep 11 16:38:02.984752 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:02.984650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5864499db4-dbf4x_9ad36943-0fe9-4ffc-b371-3c7f3ad81411/kube-auth-proxy/0.log"
Sep 11 16:38:05.227501 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:05.227467    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-6bzfr_b3ece49f-abe0-4ce6-9a25-877c954f4bd4/manager/1.log"
Sep 11 16:38:05.257595 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:05.257561    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-6bzfr_b3ece49f-abe0-4ce6-9a25-877c954f4bd4/manager/0.log"
Sep 11 16:38:05.350300 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:05.350273    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-6bzfr_b3ece49f-abe0-4ce6-9a25-877c954f4bd4/copy-manifests/0.log"
Sep 11 16:38:07.909404 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:07.909312    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d9ffdf556-49tqr_b4267f86-3680-4b26-9a72-9cc6d3556ade/manager/0.log"
Sep 11 16:38:08.110312 ip-10-0-137-9 kubenswrapper[2564]: I0911 16:38:08.110282    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wn5fr_5065da93-e741-44de-840c-cbeda23dfb99/openshift-lws-operator/0.log"